2024-09-14T07:01:08.068 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T07:01:08.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T07:01:08.239 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423 branch: main description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900423' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: rbd qos iops burst: 100 rbd qos iops limit: 50 rbd qos schedule tick min: 100 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5839 sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 sleep_before_teardown: 0 subset: 99/128 suite: rbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDepkAFLByUhrYL02WC5b3b+/a4fTQe2ilMrxmtKQz3KaQdGCYcJMuUKtfygH4nPYBMVoGKcP7MKRD4JYEYWUvo= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNh4AVTRy0J3dZRQwnInJE4MB+GMYWZMMplJSKUhs4a+gaQDjb3w/4zw/fIGaZAJRT9PLBIB2g5I0KEuM6D7fUU= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_20:16:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T07:01:08.239 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-14T07:01:08.240 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-14T07:01:08.240 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T07:01:08.241 INFO:teuthology.task.internal:Checking packages... 2024-09-14T07:01:08.263 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7f24e589328ae9e639c0009d93340e5b235d0a47' 2024-09-14T07:01:08.263 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T07:01:08.263 INFO:teuthology.packaging:ref: None 2024-09-14T07:01:08.263 INFO:teuthology.packaging:tag: None 2024-09-14T07:01:08.263 INFO:teuthology.packaging:branch: main 2024-09-14T07:01:08.263 INFO:teuthology.packaging:sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T07:01:08.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T07:01:08.477 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T07:01:08.479 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T07:01:08.488 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T07:01:08.488 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T07:01:08.503 INFO:teuthology.task.internal:Saving configuration 2024-09-14T07:01:08.516 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T07:01:08.528 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T07:01:08.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 06:56:07.537888', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDepkAFLByUhrYL02WC5b3b+/a4fTQe2ilMrxmtKQz3KaQdGCYcJMuUKtfygH4nPYBMVoGKcP7MKRD4JYEYWUvo='} 2024-09-14T07:01:08.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 06:56:07.539347', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNh4AVTRy0J3dZRQwnInJE4MB+GMYWZMMplJSKUhs4a+gaQDjb3w/4zw/fIGaZAJRT9PLBIB2g5I0KEuM6D7fUU='} 2024-09-14T07:01:08.579 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T07:01:08.591 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T07:01:08.591 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T07:01:08.591 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T07:01:08.657 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4834e0f400>, signals=[15]) 2024-09-14T07:01:08.658 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T07:01:08.669 INFO:teuthology.task.internal:Opening connections... 2024-09-14T07:01:08.669 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:01:08.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:01:08.744 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:01:08.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:01:08.819 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T07:01:08.831 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-14T07:01:08.850 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-14T07:01:08.850 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-14T07:01:08.908 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-14T07:01:08.908 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-14T07:01:08.908 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-14T07:01:08.908 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-14T07:01:08.908 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-14T07:01:08.908 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T07:01:08.909 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T07:01:08.910 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-14T07:01:08.930 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-14T07:01:08.948 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-14T07:01:08.948 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T07:01:09.007 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-09-14T07:01:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-09-14T07:01:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T07:01:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-09-14T07:01:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T07:01:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T07:01:09.008 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T07:01:09.008 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-14T07:01:09.030 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T07:01:09.044 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T07:01:09.059 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T07:01:09.059 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-14T07:01:09.062 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-14T07:01:09.078 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T07:01:09.090 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T07:01:09.090 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-14T07:01:09.119 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-14T07:01:09.222 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T07:01:09.269 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T07:01:09.290 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T07:01:09.290 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T07:01:09.290 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T07:01:09.291 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T07:01:09.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:01:09.308 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-14T07:01:09.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:01:09.309 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-14T07:01:09.365 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-503.el9.x86_64 2024-09-14T07:01:09.366 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-503.el9.x86_64 2024-09-14T07:01:09.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-09-14T07:01:09.367 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-503.el9.x86_64 2024-09-14T07:01:09.367 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.14.0-503.el9.x86_64 2024-09-14T07:01:09.367 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2024-09-14T07:01:11.606 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-14T07:01:12.539 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.2 MB 00:01 2024-09-14T07:01:13.332 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-14T07:01:18.222 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-14T07:01:19.774 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-14T07:01:22.025 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-14T07:01:22.812 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-14T07:01:23.530 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-14T07:01:25.214 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-14T07:01:26.244 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-14T07:01:28.377 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T07:01:30.391 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T07:01:30.391 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T07:01:30.488 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T07:01:30.500 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:Install 4 Packages 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 79 M 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 126 M 2024-09-14T07:01:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:01:30.678 INFO:teuthology.orchestra.run.smithi086.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 180 kB/s | 23 kB 00:00 2024-09-14T07:01:31.137 INFO:teuthology.orchestra.run.smithi086.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 62 MB/s | 29 MB 00:00 2024-09-14T07:01:31.403 INFO:teuthology.orchestra.run.smithi086.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-14T07:01:31.699 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T07:01:31.970 INFO:teuthology.orchestra.run.smithi086.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-14T07:01:31.971 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:01:31.971 INFO:teuthology.orchestra.run.smithi086.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-14T07:01:32.650 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:01:32.986 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:01:32.986 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:01:33.714 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T07:01:33.714 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T07:01:33.811 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:01:33.815 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-14T07:01:33.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:01:33.816 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 79 M 2024-09-14T07:01:33.816 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 126 M 2024-09-14T07:01:33.816 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:01:33.951 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:01:33.951 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:01:34.184 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 252 kB/s | 23 kB 00:00 2024-09-14T07:01:36.388 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:01:36.542 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-14T07:01:37.134 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T07:01:37.221 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T07:01:38.126 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.2 MB/s | 29 MB 00:03 2024-09-14T07:01:39.101 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.9 MB/s | 35 MB 00:05 2024-09-14T07:01:39.101 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:01:39.101 INFO:teuthology.orchestra.run.smithi071.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-14T07:01:39.784 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:01:40.014 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T07:01:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:01:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:01:40.157 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T07:01:41.086 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:01:41.087 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:01:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:01:44.186 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T07:01:44.278 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T07:01:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T07:01:45.024 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:01:47.086 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T07:01:47.224 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T07:01:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:01:52.069 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T07:01:52.115 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:01:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:27.907 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:27.946 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:28.284 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:28.284 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T07:02:28.284 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T07:02:28.284 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:02:29.117 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:02:29.464 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T07:02:29.696 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T07:02:29.696 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T07:02:29.696 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T07:02:29.697 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T07:02:29.697 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T07:02:29.697 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T07:02:29.697 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T07:02:29.697 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T07:02:29.755 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T07:02:29.756 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T07:02:29.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2024-09-14T07:02:29.788 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2024-09-14T07:02:29.788 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2024-09-14T07:02:29.788 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.06 2024-09-14T07:02:29.788 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 82.el9 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Group : Unspecified 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 8274670 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : builder@centos.org 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2024-09-14T07:02:29.789 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:02:29.790 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T07:02:29.791 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T07:02:29.791 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 5.14.0-505.el9.x86_64 2024-09-14T07:02:29.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T07:02:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-14T07:02:31.773 INFO:teuthology.orchestra.run.smithi086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T07:02:31.814 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-14T07:02:31.816 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-14T07:02:31.831 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.uzB4fRWml6 2024-09-14T07:02:31.832 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uzB4fRWml6 2024-09-14T07:02:31.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.uzB4fRWml6 2024-09-14T07:02:32.041 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.uzB4fRWml6 is 6KB 2024-09-14T07:02:32.090 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.uzB4fRWml6 2024-09-14T07:02:32.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T07:02:32.180 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T07:02:32.180 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T07:02:32.180 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T07:02:32.180 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T07:02:32.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T07:02:32.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-09-14T07:02:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:35.445 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:35.725 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:35.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T07:02:35.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T07:02:35.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T07:02:36.573 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T07:02:36.573 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:02:36.573 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:02:36.573 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T07:02:36.574 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T07:02:36.574 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T07:02:36.574 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T07:02:36.574 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:02:36.574 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:02:36.940 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T07:02:37.026 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T07:02:37.026 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T07:02:37.026 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T07:02:37.026 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T07:02:37.026 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T07:02:37.026 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T07:02:37.026 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T07:02:37.027 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T07:02:37.085 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T07:02:37.085 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T07:02:37.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 82.el9 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T07:02:37.117 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8274670 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T07:02:37.118 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T07:02:37.119 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T07:02:37.119 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-09-14T07:02:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:02:37.119 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T07:02:37.119 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T07:02:37.120 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-505.el9.x86_64 2024-09-14T07:02:37.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T07:02:37.842 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-14T07:02:39.135 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T07:02:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-14T07:02:39.174 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-14T07:02:39.189 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.13JsJ4INCe 2024-09-14T07:02:39.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.13JsJ4INCe 2024-09-14T07:02:39.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.13JsJ4INCe 2024-09-14T07:02:39.391 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.13JsJ4INCe is 6KB 2024-09-14T07:02:39.412 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.13JsJ4INCe 2024-09-14T07:02:39.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T07:02:39.499 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T07:02:39.500 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T07:02:39.500 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T07:02:39.500 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T07:02:39.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T07:02:39.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-14T07:03:02.381 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T07:03:02.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:03:02.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:03:09.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T07:03:09.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:03:09.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:03:20.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-14T07:03:28.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-14T07:03:29.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:03:29.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:03:32.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-14T07:03:37.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:03:37.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:03:40.125 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-14T07:03:44.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:03:44.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:03:52.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:03:52.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:04:03.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-14T07:04:10.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-14T07:04:18.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:04:18.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:04:18.823 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-14T07:04:19.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:04:19.210 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T07:04:19.210 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-14T07:04:19.224 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-505.el9.x86_64 2024-09-14T07:04:19.224 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T07:04:19.224 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T07:04:19.224 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T07:04:20.225 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T07:04:20.225 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T07:04:20.389 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-09-14T07:04:20.427 DEBUG:teuthology.parallel:result is None 2024-09-14T07:04:25.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:04:25.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:04:25.912 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-14T07:04:26.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:04:26.253 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T07:04:26.253 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-14T07:04:26.268 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-505.el9.x86_64 2024-09-14T07:04:26.268 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T07:04:26.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T07:04:26.268 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T07:04:27.269 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T07:04:27.269 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T07:04:27.406 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-09-14T07:04:27.427 DEBUG:teuthology.parallel:result is None 2024-09-14T07:04:27.427 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T07:04:27.435 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T07:04:27.435 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T07:04:27.438 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T07:04:27.476 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T07:04:27.484 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T07:04:27.495 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T07:04:27.496 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T07:04:27.518 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T07:04:27.580 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T07:04:27.587 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T07:04:27.587 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T07:04:27.589 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T07:04:27.632 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T07:04:27.644 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T07:04:27.670 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T07:04:27.686 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T07:04:27.688 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T07:04:27.696 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T07:04:27.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T07:04:27.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T07:04:27.761 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T07:04:27.775 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T07:04:27.775 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T07:04:27.777 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T07:04:27.822 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T07:04:27.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T07:04:27.958 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T07:04:28.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T07:04:28.094 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:04:28.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T07:04:28.158 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T07:04:28.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T07:04:28.254 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T07:04:28.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T07:04:28.381 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:04:28.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T07:04:28.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-14T07:04:28.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-14T07:04:28.494 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T07:04:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T07:04:28.876 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T07:04:28.885 INFO:teuthology.task.internal:Starting timer... 2024-09-14T07:04:28.885 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T07:04:28.903 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T07:04:28.919 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-14T07:04:29.035 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-14T07:04:29.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-09-14T07:04:29.081 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-09-14T07:04:29.083 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T07:04:29.083 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-14T07:04:29.106 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-14T07:04:29.106 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-09-14T07:04:29.158 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-09-14T07:04:29.159 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive'} 2024-09-14T07:04:29.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T07:04:29.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:04:29.183 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T07:04:29.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:04:29.227 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T07:04:29.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-14T07:04:29.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-09-14T07:04:29.313 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T07:04:29.322 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T07:04:29.335 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T07:04:29.336 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T07:08:18.732 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2024-09-14T07:08:18.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:08:18.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:08:18.809 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-14T07:08:18.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T07:08:18.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:08:18.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T07:08:18.964 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-14T07:08:19.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T07:08:19.042 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T07:08:19.052 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T07:08:19.052 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T07:08:19.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T07:08:19.055 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T07:08:19.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T07:08:19.082 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T07:08:19.097 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T07:08:19.112 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T07:08:19.120 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-14T07:08:19.126 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T07:08:19.131 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-14T07:08:19.145 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T07:08:19.151 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-09-14T07:08:19.159 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T07:08:19.162 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-09-14T07:08:19.176 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T07:08:19.190 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T07:08:19.214 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-14T07:08:19.217 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T07:08:19.217 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-14T07:08:19.217 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.217 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.217 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.218 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.250 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-14T07:08:19.253 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T07:08:19.253 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-14T07:08:19.254 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.254 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.254 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.254 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:08:19.255 INFO:teuthology.run_tasks:Running task install... 2024-09-14T07:08:19.262 DEBUG:teuthology.task.install:project ceph 2024-09-14T07:08:19.262 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}} 2024-09-14T07:08:19.262 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'} 2024-09-14T07:08:19.262 INFO:teuthology.task.install:Using flavor: default 2024-09-14T07:08:19.268 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T07:08:19.268 INFO:teuthology.task.install:extra packages: [] 2024-09-14T07:08:19.268 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T07:08:19.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T07:08:19.271 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T07:08:19.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T07:08:19.416 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T07:08:19.416 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T07:08:19.431 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T07:08:19.431 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T07:08:19.526 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T07:08:19.526 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:08:19.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T07:08:19.537 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T07:08:19.537 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:08:19.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T07:08:19.552 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-14T07:08:19.552 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T07:08:19.564 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-14T07:08:19.564 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T07:08:19.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T07:08:19.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T07:08:19.692 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T07:08:19.706 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T07:08:19.757 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-14T07:08:19.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-14T07:08:19.770 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-09-14T07:08:19.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-09-14T07:08:19.981 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-14T07:08:19.994 INFO:teuthology.orchestra.run.smithi086.stdout:45 files removed 2024-09-14T07:08:20.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2024-09-14T07:08:20.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw 2024-09-14T07:08:20.553 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-14T07:08:20.567 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-14T07:08:20.845 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T07:08:20.859 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T07:08:21.121 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T07:08:21.135 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T07:08:22.713 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-14T07:08:22.918 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-14T07:08:24.688 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-14T07:08:24.928 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-14T07:08:29.039 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-14T07:08:30.598 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-14T07:08:30.687 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-14T07:08:31.385 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-14T07:08:32.171 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-14T07:08:32.917 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-14T07:08:37.016 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-14T07:08:38.315 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-14T07:08:39.436 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:08:39.448 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T07:08:39.449 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T07:08:39.450 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:Install 31 Packages 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-09-14T07:08:39.451 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:08:39.452 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 62 M 2024-09-14T07:08:39.452 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:08:40.152 INFO:teuthology.orchestra.run.smithi071.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-14T07:08:40.235 INFO:teuthology.orchestra.run.smithi071.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 302 kB/s | 25 kB 00:00 2024-09-14T07:08:40.386 INFO:teuthology.orchestra.run.smithi071.stdout:(3/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 14 MB/s | 11 MB 00:00 2024-09-14T07:08:40.428 INFO:teuthology.orchestra.run.smithi071.stdout:(4/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 3.8 MB/s | 755 kB 00:00 2024-09-14T07:08:40.453 INFO:teuthology.orchestra.run.smithi071.stdout:(5/33): libradosstriper1-19.3.0-4775.g7f24e589. 7.4 MB/s | 508 kB 00:00 2024-09-14T07:08:40.503 INFO:teuthology.orchestra.run.smithi071.stdout:(6/33): python3-ceph-argparse-19.3.0-4775.g7f24 906 kB/s | 45 kB 00:00 2024-09-14T07:08:40.578 INFO:teuthology.orchestra.run.smithi071.stdout:(7/33): python3-ceph-common-19.3.0-4775.g7f24e5 1.9 MB/s | 143 kB 00:00 2024-09-14T07:08:40.700 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:08:40.704 INFO:teuthology.orchestra.run.smithi071.stdout:(8/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_6 20 MB/s | 5.5 MB 00:00 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:08:40.728 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T07:08:40.729 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T07:08:40.730 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout:Install 31 Packages 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2024-09-14T07:08:40.731 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:08:40.732 INFO:teuthology.orchestra.run.smithi071.stdout:(9/33): python3-cephfs-19.3.0-4775.g7f24e589.el 1.0 MB/s | 161 kB 00:00 2024-09-14T07:08:40.732 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 62 M 2024-09-14T07:08:40.732 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:08:40.754 INFO:teuthology.orchestra.run.smithi071.stdout:(10/33): python3-rados-19.3.0-4775.g7f24e589.el 6.3 MB/s | 321 kB 00:00 2024-09-14T07:08:40.779 INFO:teuthology.orchestra.run.smithi071.stdout:(11/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 5.9 MB/s | 306 kB 00:00 2024-09-14T07:08:40.805 INFO:teuthology.orchestra.run.smithi071.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.9 MB/s | 99 kB 00:00 2024-09-14T07:08:41.005 INFO:teuthology.orchestra.run.smithi071.stdout:(13/33): ceph-common-19.3.0-4775.g7f24e589.el9. 15 MB/s | 22 MB 00:01 2024-09-14T07:08:41.097 INFO:teuthology.orchestra.run.smithi071.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-14T07:08:41.130 INFO:teuthology.orchestra.run.smithi071.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 524 kB/s | 171 kB 00:00 2024-09-14T07:08:41.155 INFO:teuthology.orchestra.run.smithi071.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-14T07:08:41.172 INFO:teuthology.orchestra.run.smithi071.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-14T07:08:41.206 INFO:teuthology.orchestra.run.smithi071.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-09-14T07:08:41.239 INFO:teuthology.orchestra.run.smithi071.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-14T07:08:41.273 INFO:teuthology.orchestra.run.smithi071.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-14T07:08:41.298 INFO:teuthology.orchestra.run.smithi071.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 613 kB/s | 36 kB 00:00 2024-09-14T07:08:41.324 INFO:teuthology.orchestra.run.smithi071.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-14T07:08:41.349 INFO:teuthology.orchestra.run.smithi071.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-14T07:08:41.407 INFO:teuthology.orchestra.run.smithi071.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-14T07:08:41.433 INFO:teuthology.orchestra.run.smithi071.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-14T07:08:41.458 INFO:teuthology.orchestra.run.smithi071.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-09-14T07:08:41.483 INFO:teuthology.orchestra.run.smithi071.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T07:08:41.525 INFO:teuthology.orchestra.run.smithi071.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-14T07:08:41.576 INFO:teuthology.orchestra.run.smithi071.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-14T07:08:41.626 INFO:teuthology.orchestra.run.smithi071.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T07:08:41.682 INFO:teuthology.orchestra.run.smithi086.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 9.0 MB/s | 5.5 MB 00:00 2024-09-14T07:08:41.702 INFO:teuthology.orchestra.run.smithi071.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-14T07:08:41.766 INFO:teuthology.orchestra.run.smithi086.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 303 kB/s | 25 kB 00:00 2024-09-14T07:08:41.883 INFO:teuthology.orchestra.run.smithi086.stdout:(3/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 13 MB/s | 11 MB 00:00 2024-09-14T07:08:41.916 INFO:teuthology.orchestra.run.smithi086.stdout:(4/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 4.9 MB/s | 755 kB 00:00 2024-09-14T07:08:41.975 INFO:teuthology.orchestra.run.smithi086.stdout:(5/33): libradosstriper1-19.3.0-4775.g7f24e589. 5.4 MB/s | 508 kB 00:00 2024-09-14T07:08:41.993 INFO:teuthology.orchestra.run.smithi071.stdout:(32/33): librados2-19.3.0-4775.g7f24e589.el9.x8 8.3 MB/s | 3.5 MB 00:00 2024-09-14T07:08:42.052 INFO:teuthology.orchestra.run.smithi071.stdout:(33/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 7.6 MB/s | 3.2 MB 00:00 2024-09-14T07:08:42.056 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:08:42.057 INFO:teuthology.orchestra.run.smithi071.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-14T07:08:42.059 INFO:teuthology.orchestra.run.smithi086.stdout:(6/33): python3-ceph-argparse-19.3.0-4775.g7f24 541 kB/s | 45 kB 00:00 2024-09-14T07:08:42.151 INFO:teuthology.orchestra.run.smithi086.stdout:(7/33): python3-ceph-common-19.3.0-4775.g7f24e5 1.5 MB/s | 143 kB 00:00 2024-09-14T07:08:42.168 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:08:42.204 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:08:42.204 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:08:42.351 INFO:teuthology.orchestra.run.smithi086.stdout:(8/33): ceph-common-19.3.0-4775.g7f24e589.el9.x 17 MB/s | 22 MB 00:01 2024-09-14T07:08:42.376 INFO:teuthology.orchestra.run.smithi086.stdout:(9/33): python3-cephfs-19.3.0-4775.g7f24e589.el 716 kB/s | 161 kB 00:00 2024-09-14T07:08:42.401 INFO:teuthology.orchestra.run.smithi086.stdout:(10/33): python3-rados-19.3.0-4775.g7f24e589.el 6.3 MB/s | 321 kB 00:00 2024-09-14T07:08:42.427 INFO:teuthology.orchestra.run.smithi086.stdout:(11/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 6.0 MB/s | 306 kB 00:00 2024-09-14T07:08:42.452 INFO:teuthology.orchestra.run.smithi086.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.9 MB/s | 99 kB 00:00 2024-09-14T07:08:42.527 INFO:teuthology.orchestra.run.smithi086.stdout:(13/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_ 9.0 MB/s | 5.5 MB 00:00 2024-09-14T07:08:42.611 INFO:teuthology.orchestra.run.smithi086.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 582 kB/s | 107 kB 00:00 2024-09-14T07:08:42.636 INFO:teuthology.orchestra.run.smithi086.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 928 kB/s | 171 kB 00:00 2024-09-14T07:08:42.661 INFO:teuthology.orchestra.run.smithi086.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-14T07:08:42.687 INFO:teuthology.orchestra.run.smithi086.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-14T07:08:42.728 INFO:teuthology.orchestra.run.smithi086.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-14T07:08:42.754 INFO:teuthology.orchestra.run.smithi086.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-14T07:08:42.779 INFO:teuthology.orchestra.run.smithi086.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-14T07:08:42.804 INFO:teuthology.orchestra.run.smithi086.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-14T07:08:42.829 INFO:teuthology.orchestra.run.smithi086.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-14T07:08:42.855 INFO:teuthology.orchestra.run.smithi086.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-14T07:08:42.873 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:08:42.873 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:08:42.913 INFO:teuthology.orchestra.run.smithi086.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-14T07:08:42.939 INFO:teuthology.orchestra.run.smithi086.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-14T07:08:42.964 INFO:teuthology.orchestra.run.smithi086.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 277 kB/s | 26 kB 00:00 2024-09-14T07:08:42.989 INFO:teuthology.orchestra.run.smithi086.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T07:08:43.015 INFO:teuthology.orchestra.run.smithi086.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-14T07:08:43.065 INFO:teuthology.orchestra.run.smithi086.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-14T07:08:43.115 INFO:teuthology.orchestra.run.smithi086.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T07:08:43.199 INFO:teuthology.orchestra.run.smithi086.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T07:08:43.424 INFO:teuthology.orchestra.run.smithi086.stdout:(32/33): librados2-19.3.0-4775.g7f24e589.el9.x8 9.6 MB/s | 3.5 MB 00:00 2024-09-14T07:08:43.482 INFO:teuthology.orchestra.run.smithi086.stdout:(33/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 8.8 MB/s | 3.2 MB 00:00 2024-09-14T07:08:43.488 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:08:43.488 INFO:teuthology.orchestra.run.smithi086.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-14T07:08:43.602 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:08:43.639 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:08:43.639 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:08:44.320 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:08:44.320 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:08:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:08:44.460 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T07:08:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T07:08:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T07:08:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T07:08:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T07:08:44.706 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T07:08:44.759 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T07:08:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T07:08:45.233 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T07:08:45.359 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T07:08:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T07:08:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T07:08:45.548 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T07:08:45.585 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T07:08:45.628 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T07:08:45.697 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T07:08:45.728 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T07:08:45.792 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T07:08:45.835 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T07:08:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:08:45.927 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T07:08:45.943 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T07:08:45.956 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T07:08:45.978 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T07:08:45.981 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T07:08:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T07:08:46.019 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T07:08:46.024 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T07:08:46.059 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T07:08:46.089 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T07:08:46.132 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T07:08:46.167 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T07:08:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T07:08:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T07:08:46.485 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T07:08:46.519 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T07:08:46.610 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T07:08:46.633 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T07:08:46.645 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T07:08:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T07:08:46.716 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T07:08:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T07:08:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T07:08:46.926 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T07:08:46.988 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T07:08:47.016 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T07:08:47.061 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T07:08:47.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T07:08:47.153 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T07:08:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T07:08:47.216 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T07:08:47.221 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T07:08:47.251 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T07:08:47.293 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T07:08:47.366 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T07:08:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T07:08:47.394 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T07:08:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T07:08:47.440 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T07:08:47.467 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T07:08:47.496 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T07:08:47.529 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T07:08:47.572 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T07:08:47.928 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T07:08:47.967 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T07:08:48.060 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T07:08:48.097 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T07:08:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T07:08:48.666 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T07:08:48.694 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T07:08:48.749 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T07:08:48.829 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T07:08:48.863 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T07:08:49.692 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T07:08:49.728 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T07:08:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T07:08:50.439 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T07:08:50.528 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T07:08:50.528 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T07:08:50.528 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T07:08:50.529 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:08:50.566 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T07:08:51.168 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T07:08:51.209 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T07:08:51.778 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T07:08:51.821 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T07:08:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T07:08:51.905 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T07:08:51.905 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T07:08:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:08:51.947 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T07:09:00.599 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T07:09:00.599 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-14T07:09:00.599 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-14T07:09:00.600 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-14T07:09:00.600 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-14T07:09:00.600 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-14T07:09:00.600 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-14T07:09:00.600 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-14T07:09:00.600 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T07:09:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T07:09:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T07:09:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T07:09:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T07:09:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T07:09:01.799 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T07:09:01.800 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-09-14T07:09:01.876 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-09-14T07:09:01.877 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-09-14T07:09:01.877 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:02.877 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T07:09:02.908 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T07:09:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T07:09:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T07:09:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T07:09:02.908 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T07:09:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T07:09:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T07:09:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T07:09:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T07:09:02.914 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T07:09:02.996 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T07:09:02.997 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.913 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T07:09:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T07:09:03.915 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T07:09:03.916 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T07:09:03.916 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T07:09:03.916 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:03.916 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T07:09:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T07:09:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T07:09:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T07:09:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T07:09:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T07:09:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T07:09:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T07:09:04.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2024-09-14T07:09:04.831 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:04.970 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:04.970 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:09:04.971 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:04.971 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T07:09:04.971 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:09:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T07:09:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T07:09:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T07:09:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:04.972 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:04.972 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:04.973 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-14T07:09:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:04.974 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 51 M 2024-09-14T07:09:04.974 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 217 M 2024-09-14T07:09:04.974 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T07:09:05.137 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T07:09:05.138 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T07:09:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T07:09:05.139 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:05.139 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-14T07:09:05.187 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-14T07:09:05.396 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 402 kB/s | 162 kB 00:00 2024-09-14T07:09:05.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-test 2024-09-14T07:09:06.094 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:06.230 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:09:06.231 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:06.232 INFO:teuthology.orchestra.run.smithi086.stdout:Install 4 Packages 2024-09-14T07:09:06.232 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:06.232 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 51 M 2024-09-14T07:09:06.232 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 217 M 2024-09-14T07:09:06.232 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:09:06.667 INFO:teuthology.orchestra.run.smithi086.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-14T07:09:06.742 INFO:teuthology.orchestra.run.smithi086.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-09-14T07:09:06.976 INFO:teuthology.orchestra.run.smithi086.stdout:(3/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 347 kB/s | 162 kB 00:00 2024-09-14T07:09:09.070 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 50 MB 00:04 2024-09-14T07:09:09.072 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:09.073 INFO:teuthology.orchestra.run.smithi071.stdout:Total 12 MB/s | 51 MB 00:04 2024-09-14T07:09:09.100 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:09.513 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:09.513 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:09:10.061 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:09:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T07:09:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T07:09:10.222 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T07:09:12.167 INFO:teuthology.orchestra.run.smithi086.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 8.9 MB/s | 50 MB 00:05 2024-09-14T07:09:12.169 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:12.169 INFO:teuthology.orchestra.run.smithi086.stdout:Total 8.5 MB/s | 51 MB 00:05 2024-09-14T07:09:12.193 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:09:12.211 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:09:12.211 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:09:12.609 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:09:12.610 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:09:13.146 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:09:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T07:09:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T07:09:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T07:09:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T07:09:15.086 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T07:09:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T07:09:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T07:09:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T07:09:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T07:09:17.908 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T07:09:17.908 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:17.908 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:17.908 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:17.908 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:17.908 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T07:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T07:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:18.048 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T07:09:18.125 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T07:09:18.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2024-09-14T07:09:18.735 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:42 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:18.870 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T07:09:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T07:09:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T07:09:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout:Install 37 Packages 2024-09-14T07:09:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:18.877 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 31 M 2024-09-14T07:09:18.877 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 109 M 2024-09-14T07:09:18.877 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:19.662 INFO:teuthology.orchestra.run.smithi071.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 30 kB/s | 6.6 kB 00:00 2024-09-14T07:09:20.120 INFO:teuthology.orchestra.run.smithi071.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 2.2 MB/s | 1.5 MB 00:00 2024-09-14T07:09:20.354 INFO:teuthology.orchestra.run.smithi071.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 2.6 MB/s | 2.4 MB 00:00 2024-09-14T07:09:20.446 INFO:teuthology.orchestra.run.smithi071.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 3.1 MB/s | 291 kB 00:00 2024-09-14T07:09:20.553 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T07:09:20.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T07:09:20.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T07:09:20.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T07:09:20.571 INFO:teuthology.orchestra.run.smithi071.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-14T07:09:20.697 INFO:teuthology.orchestra.run.smithi071.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 9.8 MB/s | 1.2 MB 00:00 2024-09-14T07:09:20.772 INFO:teuthology.orchestra.run.smithi071.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-14T07:09:20.839 INFO:teuthology.orchestra.run.smithi071.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-14T07:09:20.871 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T07:09:20.871 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:20.871 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:09:20.871 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:20.871 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:20.871 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T07:09:20.872 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T07:09:20.872 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:20.872 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:20.897 INFO:teuthology.orchestra.run.smithi071.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-14T07:09:20.973 INFO:teuthology.orchestra.run.smithi071.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-14T07:09:21.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph 2024-09-14T07:09:21.281 INFO:teuthology.orchestra.run.smithi071.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 611 kB/s | 188 kB 00:00 2024-09-14T07:09:21.365 INFO:teuthology.orchestra.run.smithi071.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-14T07:09:21.423 INFO:teuthology.orchestra.run.smithi071.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 595 kB/s | 35 kB 00:00 2024-09-14T07:09:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.1 MB/s | 77 kB 00:00 2024-09-14T07:09:21.649 INFO:teuthology.orchestra.run.smithi071.stdout:(15/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86 11 MB/s | 17 MB 00:01 2024-09-14T07:09:21.674 INFO:teuthology.orchestra.run.smithi071.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 278 kB/s | 51 kB 00:00 2024-09-14T07:09:21.714 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:43 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:21.744 INFO:teuthology.orchestra.run.smithi071.stdout:(17/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86 2.3 MB/s | 4.8 MB 00:02 2024-09-14T07:09:21.786 INFO:teuthology.orchestra.run.smithi071.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-14T07:09:21.811 INFO:teuthology.orchestra.run.smithi071.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-14T07:09:21.837 INFO:teuthology.orchestra.run.smithi071.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 137 kB/s | 22 kB 00:00 2024-09-14T07:09:21.856 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T07:09:21.859 INFO:teuthology.orchestra.run.smithi086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T07:09:21.860 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T07:09:21.861 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout:Install 37 Packages 2024-09-14T07:09:21.862 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:21.863 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 31 M 2024-09-14T07:09:21.863 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 109 M 2024-09-14T07:09:21.863 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:09:21.870 INFO:teuthology.orchestra.run.smithi071.stdout:(21/37): python3-toml-0.10.2-6.el9.noarch.rpm 188 kB/s | 42 kB 00:00 2024-09-14T07:09:21.895 INFO:teuthology.orchestra.run.smithi071.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-14T07:09:21.937 INFO:teuthology.orchestra.run.smithi071.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 519 kB/s | 18 kB 00:00 2024-09-14T07:09:21.971 INFO:teuthology.orchestra.run.smithi071.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 108 kB/s | 11 kB 00:00 2024-09-14T07:09:21.996 INFO:teuthology.orchestra.run.smithi071.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 407 kB/s | 23 kB 00:00 2024-09-14T07:09:22.021 INFO:teuthology.orchestra.run.smithi071.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 783 kB/s | 19 kB 00:00 2024-09-14T07:09:22.047 INFO:teuthology.orchestra.run.smithi071.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 394 kB/s | 20 kB 00:00 2024-09-14T07:09:22.072 INFO:teuthology.orchestra.run.smithi071.stdout:(28/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-14T07:09:22.097 INFO:teuthology.orchestra.run.smithi071.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 616 kB/s | 46 kB 00:00 2024-09-14T07:09:22.122 INFO:teuthology.orchestra.run.smithi071.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-14T07:09:22.148 INFO:teuthology.orchestra.run.smithi071.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-14T07:09:22.173 INFO:teuthology.orchestra.run.smithi071.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-14T07:09:22.198 INFO:teuthology.orchestra.run.smithi071.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-14T07:09:22.224 INFO:teuthology.orchestra.run.smithi071.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-14T07:09:22.249 INFO:teuthology.orchestra.run.smithi071.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-14T07:09:22.274 INFO:teuthology.orchestra.run.smithi071.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-14T07:09:22.299 INFO:teuthology.orchestra.run.smithi071.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-14T07:09:22.305 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:22.305 INFO:teuthology.orchestra.run.smithi071.stdout:Total 9.0 MB/s | 31 MB 00:03 2024-09-14T07:09:22.325 INFO:teuthology.orchestra.run.smithi086.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-14T07:09:22.453 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:22.484 INFO:teuthology.orchestra.run.smithi086.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 5.4 MB/s | 1.5 MB 00:00 2024-09-14T07:09:22.491 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:22.491 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:22.551 INFO:teuthology.orchestra.run.smithi086.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 6.8 MB/s | 2.4 MB 00:00 2024-09-14T07:09:22.626 INFO:teuthology.orchestra.run.smithi086.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 3.8 MB/s | 291 kB 00:00 2024-09-14T07:09:22.693 INFO:teuthology.orchestra.run.smithi086.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 13 MB/s | 4.8 MB 00:00 2024-09-14T07:09:22.860 INFO:teuthology.orchestra.run.smithi086.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-14T07:09:22.910 INFO:teuthology.orchestra.run.smithi086.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-14T07:09:22.975 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:22.975 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:09:23.094 INFO:teuthology.orchestra.run.smithi086.stdout:(8/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86_ 28 MB/s | 17 MB 00:00 2024-09-14T07:09:23.128 INFO:teuthology.orchestra.run.smithi086.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 2.8 MB/s | 1.2 MB 00:00 2024-09-14T07:09:23.144 INFO:teuthology.orchestra.run.smithi086.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 578 kB/s | 135 kB 00:00 2024-09-14T07:09:23.186 INFO:teuthology.orchestra.run.smithi086.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-14T07:09:23.262 INFO:teuthology.orchestra.run.smithi086.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 747 kB/s | 125 kB 00:00 2024-09-14T07:09:23.354 INFO:teuthology.orchestra.run.smithi086.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 902 kB/s | 188 kB 00:00 2024-09-14T07:09:23.379 INFO:teuthology.orchestra.run.smithi086.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-14T07:09:23.404 INFO:teuthology.orchestra.run.smithi086.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 793 kB/s | 172 kB 00:00 2024-09-14T07:09:23.429 INFO:teuthology.orchestra.run.smithi086.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-14T07:09:23.455 INFO:teuthology.orchestra.run.smithi086.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-14T07:09:23.480 INFO:teuthology.orchestra.run.smithi086.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 506 kB/s | 51 kB 00:00 2024-09-14T07:09:23.522 INFO:teuthology.orchestra.run.smithi086.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-14T07:09:23.547 INFO:teuthology.orchestra.run.smithi086.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-14T07:09:23.581 INFO:teuthology.orchestra.run.smithi086.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-14T07:09:23.606 INFO:teuthology.orchestra.run.smithi086.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 458 kB/s | 11 kB 00:00 2024-09-14T07:09:23.631 INFO:teuthology.orchestra.run.smithi086.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-14T07:09:23.656 INFO:teuthology.orchestra.run.smithi086.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2024-09-14T07:09:23.682 INFO:teuthology.orchestra.run.smithi086.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-14T07:09:23.707 INFO:teuthology.orchestra.run.smithi086.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-14T07:09:23.732 INFO:teuthology.orchestra.run.smithi086.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-14T07:09:23.757 INFO:teuthology.orchestra.run.smithi086.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-14T07:09:23.783 INFO:teuthology.orchestra.run.smithi086.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-14T07:09:23.833 INFO:teuthology.orchestra.run.smithi086.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-14T07:09:23.858 INFO:teuthology.orchestra.run.smithi086.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 219 kB/s | 16 kB 00:00 2024-09-14T07:09:23.883 INFO:teuthology.orchestra.run.smithi086.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-14T07:09:23.909 INFO:teuthology.orchestra.run.smithi086.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-14T07:09:23.934 INFO:teuthology.orchestra.run.smithi086.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-14T07:09:23.960 INFO:teuthology.orchestra.run.smithi086.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 789 kB/s | 20 kB 00:00 2024-09-14T07:09:23.985 INFO:teuthology.orchestra.run.smithi086.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-14T07:09:24.010 INFO:teuthology.orchestra.run.smithi086.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-14T07:09:24.013 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:24.014 INFO:teuthology.orchestra.run.smithi086.stdout:Total 14 MB/s | 31 MB 00:02 2024-09-14T07:09:24.165 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:09:24.205 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:09:24.205 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:09:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:09:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T07:09:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T07:09:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T07:09:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T07:09:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T07:09:24.628 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T07:09:24.692 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:09:24.692 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:09:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T07:09:24.791 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T07:09:24.848 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T07:09:24.882 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T07:09:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T07:09:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T07:09:24.980 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T07:09:25.020 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T07:09:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T07:09:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T07:09:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T07:09:25.178 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T07:09:25.253 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T07:09:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T07:09:25.486 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T07:09:25.539 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T07:09:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T07:09:25.626 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T07:09:25.690 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T07:09:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T07:09:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T07:09:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T07:09:26.044 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:09:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T07:09:26.104 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T07:09:26.138 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T07:09:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T07:09:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T07:09:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T07:09:26.267 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T07:09:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T07:09:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T07:09:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T07:09:26.431 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T07:09:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T07:09:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T07:09:26.483 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:26.483 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T07:09:26.483 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T07:09:26.483 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T07:09:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:26.527 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T07:09:26.568 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T07:09:26.604 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T07:09:26.634 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T07:09:26.668 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T07:09:26.701 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T07:09:26.742 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T07:09:26.785 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T07:09:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T07:09:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T07:09:26.929 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T07:09:27.013 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T07:09:27.160 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T07:09:27.241 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T07:09:27.294 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T07:09:27.333 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T07:09:27.381 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T07:09:27.437 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T07:09:27.638 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T07:09:27.686 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T07:09:27.771 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T07:09:27.866 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T07:09:27.909 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T07:09:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T07:09:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T07:09:27.977 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:27.977 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T07:09:27.977 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T07:09:27.977 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T07:09:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:28.038 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T07:09:28.210 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T07:09:28.235 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T07:09:28.261 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T07:09:28.262 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:28.262 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T07:09:28.262 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T07:09:28.262 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T07:09:28.262 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:28.441 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T07:09:28.465 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T07:09:28.465 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:28.465 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T07:09:28.465 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T07:09:28.465 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T07:09:28.465 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:28.700 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T07:09:28.724 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T07:09:28.724 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:28.724 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T07:09:28.724 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T07:09:28.724 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T07:09:28.725 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:28.789 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T07:09:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T07:09:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T07:09:29.747 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:29.747 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T07:09:29.747 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T07:09:29.748 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T07:09:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T07:09:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T07:09:30.228 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:30.228 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T07:09:30.228 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T07:09:30.228 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T07:09:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T07:09:30.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T07:09:30.405 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T07:09:30.406 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T07:09:30.406 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T07:09:30.406 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T07:09:30.406 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T07:09:30.406 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T07:09:30.406 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T07:09:30.407 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T07:09:30.407 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T07:09:30.407 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T07:09:30.407 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T07:09:30.407 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T07:09:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T07:09:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T07:09:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T07:09:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T07:09:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T07:09:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T07:09:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T07:09:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T07:09:30.479 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:30.479 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T07:09:30.479 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T07:09:30.479 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T07:09:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:30.542 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T07:09:31.402 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T07:09:31.402 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:31.402 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:31.402 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T07:09:31.403 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T07:09:31.404 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:31.405 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:31.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T07:09:32.339 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T07:09:32.340 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T07:09:32.341 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T07:09:32.342 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:56 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:32.426 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:09:32.468 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:32.469 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:09:32.469 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:32.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2024-09-14T07:09:33.091 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:57 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:33.221 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:09:33.222 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 783 k 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 789 k 2024-09-14T07:09:33.223 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T07:09:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T07:09:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:33.390 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 3.1 MB/s | 783 kB 00:00 2024-09-14T07:09:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:33.474 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.0 MB/s | 783 kB 00:00 2024-09-14T07:09:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:33.480 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:09:33.558 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:09:33.769 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-base 2024-09-14T07:09:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:34.337 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:56 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:34.429 INFO:teuthology.orchestra.run.smithi086.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:09:34.440 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:34.470 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:34.471 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:09:34.471 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:34.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install cephadm 2024-09-14T07:09:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:34.681 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:34.681 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:34.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T07:09:35.096 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:57 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:35.228 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:35.229 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:09:35.229 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:35.229 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 783 k 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 789 k 2024-09-14T07:09:35.230 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:09:35.483 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:35.485 INFO:teuthology.orchestra.run.smithi086.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 3.0 MB/s | 783 kB 00:00 2024-09-14T07:09:35.486 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:35.486 INFO:teuthology.orchestra.run.smithi086.stdout:Total 3.0 MB/s | 783 kB 00:00 2024-09-14T07:09:35.487 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:09:35.492 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:09:35.492 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:09:35.498 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:09:35.498 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:09:35.569 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:09:35.618 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:35.618 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 145 k 2024-09-14T07:09:35.619 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 432 k 2024-09-14T07:09:35.620 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:35.823 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 712 kB/s | 145 kB 00:00 2024-09-14T07:09:35.824 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:35.824 INFO:teuthology.orchestra.run.smithi071.stdout:Total 706 kB/s | 145 kB 00:00 2024-09-14T07:09:35.824 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:35.832 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:35.832 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:35.890 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:35.890 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:09:36.001 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:36.041 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:09:36.089 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T07:09:36.124 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T07:09:36.124 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:36.124 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T07:09:36.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:36.467 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:36.754 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:09:36.754 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:36.754 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:09:36.754 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:36.754 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:36.754 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:36.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T07:09:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T07:09:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:37.091 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:37.091 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:37.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2024-09-14T07:09:37.539 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:37.675 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:37.675 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:37.675 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-09-14T07:09:37.675 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 145 k 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 432 k 2024-09-14T07:09:37.676 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:09:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:01 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:37.907 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 629 kB/s | 145 kB 00:00 2024-09-14T07:09:37.907 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:37.908 INFO:teuthology.orchestra.run.smithi086.stdout:Total 624 kB/s | 145 kB 00:00 2024-09-14T07:09:37.908 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:09:37.915 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:09:37.916 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:09:37.972 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:09:37.972 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:09:37.981 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:09:38.022 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:38.023 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:09:38.023 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:38.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T07:09:38.131 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:09:38.200 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T07:09:38.225 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T07:09:38.225 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:09:38.225 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T07:09:38.225 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:38.653 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:02 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:38.784 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:38.785 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T07:09:38.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-09-14T07:09:38.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:38.788 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 19 M 2024-09-14T07:09:38.788 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 159 M 2024-09-14T07:09:38.788 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T07:09:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:39.129 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:09:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:09:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:39.129 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:39.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr 2024-09-14T07:09:39.534 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4775.g7f 238 kB/s | 34 kB 00:00 2024-09-14T07:09:39.559 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 97 kB/s | 16 kB 00:00 2024-09-14T07:09:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-14T07:09:39.743 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-09-14T07:09:39.794 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-14T07:09:39.819 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-14T07:09:39.886 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-14T07:09:39.919 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-14T07:09:39.944 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-14T07:09:39.954 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:01 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:39.970 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-14T07:09:40.003 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.6 MB/s | 863 kB 00:00 2024-09-14T07:09:40.047 INFO:teuthology.orchestra.run.smithi086.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:09:40.090 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:40.091 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:09:40.091 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:40.154 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 19 MB/s | 14 MB 00:00 2024-09-14T07:09:40.157 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:40.157 INFO:teuthology.orchestra.run.smithi071.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-14T07:09:40.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T07:09:40.208 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:40.227 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:40.227 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:40.487 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:40.488 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:09:40.723 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:02 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:40.855 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:40.856 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T07:09:40.857 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout:Install 12 Packages 2024-09-14T07:09:40.858 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:40.859 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 19 M 2024-09-14T07:09:40.859 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 159 M 2024-09-14T07:09:40.859 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:09:41.084 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:09:41.162 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T07:09:41.206 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T07:09:41.251 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T07:09:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T07:09:41.379 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T07:09:41.507 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T07:09:41.594 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T07:09:41.654 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T07:09:41.677 INFO:teuthology.orchestra.run.smithi086.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4775.g7f 227 kB/s | 34 kB 00:00 2024-09-14T07:09:41.682 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T07:09:41.710 INFO:teuthology.orchestra.run.smithi086.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 89 kB/s | 16 kB 00:00 2024-09-14T07:09:41.714 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T07:09:41.844 INFO:teuthology.orchestra.run.smithi086.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-14T07:09:41.894 INFO:teuthology.orchestra.run.smithi086.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-14T07:09:41.953 INFO:teuthology.orchestra.run.smithi086.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-14T07:09:41.978 INFO:teuthology.orchestra.run.smithi086.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-14T07:09:42.053 INFO:teuthology.orchestra.run.smithi086.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-14T07:09:42.095 INFO:teuthology.orchestra.run.smithi086.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-14T07:09:42.129 INFO:teuthology.orchestra.run.smithi086.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-09-14T07:09:42.154 INFO:teuthology.orchestra.run.smithi086.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 527 kB/s | 31 kB 00:00 2024-09-14T07:09:42.179 INFO:teuthology.orchestra.run.smithi086.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-14T07:09:42.363 INFO:teuthology.orchestra.run.smithi086.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 17 MB/s | 14 MB 00:00 2024-09-14T07:09:42.368 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:42.368 INFO:teuthology.orchestra.run.smithi086.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-14T07:09:42.419 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:09:42.438 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:09:42.439 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:09:42.705 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:09:42.705 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:09:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:09:43.396 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T07:09:43.432 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T07:09:43.470 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T07:09:43.500 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T07:09:43.617 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T07:09:43.746 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T07:09:43.839 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T07:09:43.898 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T07:09:43.927 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T07:09:43.959 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T07:09:44.867 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T07:09:44.935 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T07:09:46.928 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T07:09:46.929 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T07:09:47.137 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T07:09:47.196 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T07:09:47.239 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T07:09:47.240 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T07:09:47.240 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T07:09:47.240 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T07:09:47.240 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:47.240 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:47.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T07:09:48.083 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:12 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:48.215 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T07:09:48.216 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-14T07:09:48.217 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-09-14T07:09:48.218 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:48.218 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 38 M 2024-09-14T07:09:48.218 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 212 M 2024-09-14T07:09:48.218 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:48.426 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-14T07:09:48.509 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-14T07:09:48.593 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 196 kB/s | 33 kB 00:00 2024-09-14T07:09:48.643 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-14T07:09:48.735 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-14T07:09:48.760 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T07:09:48.844 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T07:09:48.845 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T07:09:48.845 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T07:09:48.845 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T07:09:48.845 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T07:09:48.869 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-14T07:09:48.953 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.7 MB/s | 3.0 MB 00:00 2024-09-14T07:09:49.011 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.3 MB/s | 250 kB 00:00 2024-09-14T07:09:49.187 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T07:09:49.187 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T07:09:49.188 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T07:09:49.189 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:49.189 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:09:49.220 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 10 MB/s | 4.9 MB 00:00 2024-09-14T07:09:49.287 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-14T07:09:49.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T07:09:49.570 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-14T07:09:49.571 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:49.571 INFO:teuthology.orchestra.run.smithi071.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-14T07:09:49.921 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:49.946 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:49.946 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:49.992 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:11 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:09:50.130 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:09:50.131 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================= 2024-09-14T07:09:50.131 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:09:50.131 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================= 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T07:09:50.132 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================= 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout:Install 12 Packages 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 38 M 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 212 M 2024-09-14T07:09:50.133 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:09:50.375 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:50.375 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:09:50.412 INFO:teuthology.orchestra.run.smithi086.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-14T07:09:50.721 INFO:teuthology.orchestra.run.smithi086.stdout:(2/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-14T07:09:50.738 INFO:teuthology.orchestra.run.smithi086.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 101 kB/s | 33 kB 00:00 2024-09-14T07:09:50.771 INFO:teuthology.orchestra.run.smithi086.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-14T07:09:50.855 INFO:teuthology.orchestra.run.smithi086.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-14T07:09:51.064 INFO:teuthology.orchestra.run.smithi086.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 132 kB/s | 38 kB 00:00 2024-09-14T07:09:51.154 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:09:51.222 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T07:09:51.268 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T07:09:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T07:09:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T07:09:51.439 INFO:teuthology.orchestra.run.smithi086.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-14T07:09:51.577 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T07:09:51.618 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T07:09:51.702 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T07:09:51.822 INFO:teuthology.orchestra.run.smithi086.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 5.1 MB/s | 4.9 MB 00:00 2024-09-14T07:09:51.889 INFO:teuthology.orchestra.run.smithi086.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-09-14T07:09:52.264 INFO:teuthology.orchestra.run.smithi086.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-09-14T07:09:52.289 INFO:teuthology.orchestra.run.smithi086.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 537 kB/s | 250 kB 00:00 2024-09-14T07:09:52.354 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T07:09:52.473 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T07:09:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T07:09:54.717 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T07:09:54.750 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T07:09:57.366 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T07:09:57.366 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T07:09:57.367 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T07:09:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T07:09:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T07:09:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T07:09:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T07:09:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:57.787 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:09:58.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2024-09-14T07:09:58.489 INFO:teuthology.orchestra.run.smithi086.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.5 MB/s | 16 MB 00:06 2024-09-14T07:09:58.490 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:58.490 INFO:teuthology.orchestra.run.smithi086.stdout:Total 4.6 MB/s | 38 MB 00:08 2024-09-14T07:09:58.798 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:22 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:09:58.846 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:09:58.872 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:09:58.872 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:09:58.932 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T07:09:58.933 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:09:58.934 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-09-14T07:09:58.935 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:09:58.935 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.2 M 2024-09-14T07:09:58.935 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 26 M 2024-09-14T07:09:58.935 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:09:59.291 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 305 kB/s | 26 kB 00:00 2024-09-14T07:09:59.307 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:09:59.307 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:09:59.316 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 176 kB/s | 19 kB 00:00 2024-09-14T07:09:59.391 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-14T07:09:59.416 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-14T07:09:59.442 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 210 kB/s | 49 kB 00:00 2024-09-14T07:09:59.467 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-14T07:09:59.492 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-14T07:09:59.543 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-14T07:09:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-14T07:09:59.593 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T07:09:59.618 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-14T07:09:59.643 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-14T07:09:59.685 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.3 MB/s | 1.0 MB 00:00 2024-09-14T07:09:59.688 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:09:59.688 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-14T07:09:59.750 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:09:59.765 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:09:59.765 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:09:59.855 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:09:59.855 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:00.060 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:00.131 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T07:10:00.179 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T07:10:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T07:10:00.321 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T07:10:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:00.505 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T07:10:00.529 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T07:10:00.557 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T07:10:00.607 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T07:10:00.619 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T07:10:00.675 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T07:10:00.712 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T07:10:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T07:10:00.863 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T07:10:00.967 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T07:10:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T07:10:01.293 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T07:10:01.410 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T07:10:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T07:10:01.786 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T07:10:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T07:10:01.869 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T07:10:01.889 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T07:10:02.600 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T07:10:02.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T07:10:02.601 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T07:10:02.644 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T07:10:02.926 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:02.927 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:03.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T07:10:03.743 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:27 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:03.830 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T07:10:03.860 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T07:10:03.877 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:03.877 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:03.878 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:03.879 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:03.879 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-09-14T07:10:03.879 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:03.879 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 7.0 M 2024-09-14T07:10:03.879 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 33 M 2024-09-14T07:10:03.879 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:04.352 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 809 kB/s | 154 kB 00:00 2024-09-14T07:10:04.378 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-14T07:10:04.436 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-14T07:10:04.453 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 764 kB/s | 58 kB 00:00 2024-09-14T07:10:04.479 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T07:10:06.402 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T07:10:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T07:10:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T07:10:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T07:10:06.403 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T07:10:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-09-14T07:10:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:06.448 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-14T07:10:06.520 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:06.532 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:06.532 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:06.632 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:06.633 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T07:10:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T07:10:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T07:10:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T07:10:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T07:10:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:06.795 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:07.120 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T07:10:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T07:10:07.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-rook 2024-09-14T07:10:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T07:10:07.764 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:29 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T07:10:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T07:10:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T07:10:07.897 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:07.898 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T07:10:07.899 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout:Install 13 Packages 2024-09-14T07:10:07.900 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:07.901 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 2.2 M 2024-09-14T07:10:07.901 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 26 M 2024-09-14T07:10:07.901 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:08.092 INFO:teuthology.orchestra.run.smithi086.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 220 kB/s | 19 kB 00:00 2024-09-14T07:10:08.118 INFO:teuthology.orchestra.run.smithi086.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 228 kB/s | 26 kB 00:00 2024-09-14T07:10:08.176 INFO:teuthology.orchestra.run.smithi086.stdout:(3/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 288 kB/s | 49 kB 00:00 2024-09-14T07:10:08.202 INFO:teuthology.orchestra.run.smithi086.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-14T07:10:08.227 INFO:teuthology.orchestra.run.smithi086.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-14T07:10:08.252 INFO:teuthology.orchestra.run.smithi086.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-14T07:10:08.294 INFO:teuthology.orchestra.run.smithi086.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-14T07:10:08.319 INFO:teuthology.orchestra.run.smithi086.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-09-14T07:10:08.345 INFO:teuthology.orchestra.run.smithi086.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-14T07:10:08.378 INFO:teuthology.orchestra.run.smithi086.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-14T07:10:08.403 INFO:teuthology.orchestra.run.smithi086.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-14T07:10:08.437 INFO:teuthology.orchestra.run.smithi086.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-14T07:10:08.472 INFO:teuthology.orchestra.run.smithi086.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-14T07:10:08.473 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:08.473 INFO:teuthology.orchestra.run.smithi086.stdout:Total 3.9 MB/s | 2.2 MB 00:00 2024-09-14T07:10:08.537 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:08.552 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:08.552 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:08.640 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:08.642 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T07:10:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T07:10:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T07:10:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T07:10:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T07:10:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T07:10:08.992 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T07:10:08.993 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T07:10:08.993 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:08.993 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:09.144 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:09.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2024-09-14T07:10:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T07:10:09.371 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T07:10:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T07:10:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T07:10:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T07:10:09.607 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T07:10:09.710 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T07:10:09.765 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T07:10:09.850 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:33 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:09.997 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:09.997 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:09.997 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:10:09.997 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:09.997 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:09.997 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 979 k 2024-09-14T07:10:09.998 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.9 M 2024-09-14T07:10:09.999 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:10.396 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.3 MB/s | 900 kB 00:00 2024-09-14T07:10:10.488 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T07:10:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T07:10:10.588 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 175 kB/s | 80 kB 00:00 2024-09-14T07:10:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T07:10:10.589 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:10.589 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.6 MB/s | 979 kB 00:00 2024-09-14T07:10:10.600 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:10.622 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:10.622 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:10.636 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T07:10:10.665 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T07:10:10.702 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:10.702 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:10.896 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T07:10:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T07:10:11.474 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T07:10:11.474 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T07:10:11.474 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T07:10:11.474 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T07:10:11.474 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T07:10:11.474 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T07:10:11.475 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T07:10:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T07:10:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T07:10:11.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:11.819 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:12.024 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T07:10:12.024 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:12.024 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:12.024 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T07:10:12.024 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:12.024 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:12.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T07:10:12.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-volume 2024-09-14T07:10:12.617 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:34 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:12.750 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T07:10:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T07:10:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T07:10:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:12.752 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:12.752 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:12.752 INFO:teuthology.orchestra.run.smithi086.stdout:Install 6 Packages 2024-09-14T07:10:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:12.753 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 7.0 M 2024-09-14T07:10:12.753 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 33 M 2024-09-14T07:10:12.753 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:12.884 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:36 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:13.021 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 285 k 2024-09-14T07:10:13.023 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.3 M 2024-09-14T07:10:13.023 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:13.196 INFO:teuthology.orchestra.run.smithi086.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 2.0 MB/s | 248 kB 00:00 2024-09-14T07:10:13.247 INFO:teuthology.orchestra.run.smithi086.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-14T07:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T07:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-14T07:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:13.272 INFO:teuthology.orchestra.run.smithi086.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-14T07:10:13.290 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:13.290 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:13.297 INFO:teuthology.orchestra.run.smithi086.stdout:(4/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 690 kB/s | 154 kB 00:00 2024-09-14T07:10:13.322 INFO:teuthology.orchestra.run.smithi086.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-14T07:10:13.422 INFO:teuthology.orchestra.run.smithi086.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-14T07:10:13.424 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:13.424 INFO:teuthology.orchestra.run.smithi086.stdout:Total 10 MB/s | 7.0 MB 00:00 2024-09-14T07:10:13.496 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:13.507 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:13.507 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:13.586 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:10:13.601 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:10:13.602 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:10:13.602 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T07:10:13.602 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:13.606 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:13.606 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:13.925 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:14.091 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T07:10:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T07:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:14.619 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:14.655 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T07:10:14.742 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T07:10:14.811 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T07:10:14.836 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T07:10:14.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2024-09-14T07:10:15.543 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:39 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:15.545 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T07:10:15.545 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T07:10:15.546 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T07:10:15.546 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T07:10:15.546 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T07:10:15.546 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T07:10:15.683 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:15.684 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:10:15.685 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 126 k 2024-09-14T07:10:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 456 k 2024-09-14T07:10:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T07:10:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:15.825 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:15.897 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 597 kB/s | 126 kB 00:00 2024-09-14T07:10:15.897 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:15.898 INFO:teuthology.orchestra.run.smithi071.stdout:Total 592 kB/s | 126 kB 00:00 2024-09-14T07:10:15.898 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:15.904 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:15.904 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:15.973 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:15.973 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:16.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-fuse 2024-09-14T07:10:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:16.664 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:38 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:16.720 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:16.797 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:16.797 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:Install 2 Packages 2024-09-14T07:10:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:16.799 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 979 k 2024-09-14T07:10:16.799 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 2.9 M 2024-09-14T07:10:16.799 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:16.949 INFO:teuthology.orchestra.run.smithi086.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 828 kB/s | 80 kB 00:00 2024-09-14T07:10:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:16.973 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:16.973 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:17.140 INFO:teuthology.orchestra.run.smithi086.stdout:(2/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.0 MB/s | 900 kB 00:00 2024-09-14T07:10:17.141 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:17.141 INFO:teuthology.orchestra.run.smithi086.stdout:Total 2.8 MB/s | 979 kB 00:00 2024-09-14T07:10:17.153 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:17.174 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:17.175 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:17.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2024-09-14T07:10:17.254 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:17.254 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:17.451 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:17.584 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T07:10:17.664 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T07:10:17.804 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:41 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:17.895 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:17.940 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:17.941 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:17.941 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:18.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2024-09-14T07:10:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T07:10:18.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T07:10:18.588 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:18.600 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T07:10:18.600 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:18.600 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:18.600 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T07:10:18.600 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:18.600 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:18.722 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:18.723 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:18.723 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:10:18.723 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:18.723 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 32 k 2024-09-14T07:10:18.723 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 142 k 2024-09-14T07:10:18.723 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:18.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-volume 2024-09-14T07:10:18.882 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 199 kB/s | 32 kB 00:00 2024-09-14T07:10:18.883 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:18.883 INFO:teuthology.orchestra.run.smithi071.stdout:Total 198 kB/s | 32 kB 00:00 2024-09-14T07:10:18.883 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:18.887 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:18.887 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:18.898 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:18.898 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:18.993 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:19.096 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:19.439 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:41 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:19.580 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:19.581 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:19.582 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:19.582 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:10:19.582 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:19.582 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 285 k 2024-09-14T07:10:19.582 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 1.3 M 2024-09-14T07:10:19.582 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:19.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:19.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:19.705 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:19.705 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:19.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:19.705 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:19.811 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T07:10:19.812 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:19.812 INFO:teuthology.orchestra.run.smithi086.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-14T07:10:19.812 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:19.821 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:19.821 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:19.850 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:19.850 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:19.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2024-09-14T07:10:20.077 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:20.138 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:10:20.155 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:10:20.155 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:10:20.155 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T07:10:20.155 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:20.455 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:20.545 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:20.588 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:20.589 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:20.589 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:20.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2024-09-14T07:10:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T07:10:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:21.192 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T07:10:21.192 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:21.192 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:21.314 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:21.356 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:21.357 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:21.358 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:21.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2024-09-14T07:10:21.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados-devel 2024-09-14T07:10:21.993 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:22.055 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:22.085 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:22.128 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:22.129 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:22.129 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:22.195 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:22.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:22.197 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 126 k 2024-09-14T07:10:22.198 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 456 k 2024-09-14T07:10:22.198 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:22.382 INFO:teuthology.orchestra.run.smithi086.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 684 kB/s | 126 kB 00:00 2024-09-14T07:10:22.382 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:22.382 INFO:teuthology.orchestra.run.smithi086.stdout:Total 679 kB/s | 126 kB 00:00 2024-09-14T07:10:22.383 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:22.388 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:22.388 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:22.454 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:22.455 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:22.601 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:22.704 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:22.756 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:22.847 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:22.890 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:22.891 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:22.891 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:22.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2024-09-14T07:10:23.149 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:23.416 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:23.416 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:23.416 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:23.416 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:23.416 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:23.416 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:23.529 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:23.620 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:23.657 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install libcephfs2 2024-09-14T07:10:23.662 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:23.663 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:23.663 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:23.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2024-09-14T07:10:24.230 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:24.302 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:24.322 INFO:teuthology.orchestra.run.smithi086.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:24.366 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:24.367 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:24.367 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:24.392 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:24.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install libcephfs-devel 2024-09-14T07:10:24.435 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:24.436 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-14T07:10:24.436 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:24.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2024-09-14T07:10:24.992 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:25.066 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:25.124 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:10:25.125 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:25.125 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 32 k 2024-09-14T07:10:25.125 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 142 k 2024-09-14T07:10:25.125 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:25.200 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:25.201 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-14T07:10:25.201 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:25.201 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T07:10:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 85 k 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 231 k 2024-09-14T07:10:25.202 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:25.301 INFO:teuthology.orchestra.run.smithi086.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 180 kB/s | 32 kB 00:00 2024-09-14T07:10:25.302 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:25.302 INFO:teuthology.orchestra.run.smithi086.stdout:Total 179 kB/s | 32 kB 00:00 2024-09-14T07:10:25.302 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:25.305 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:25.305 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:25.320 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:25.320 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:25.394 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 443 kB/s | 85 kB 00:00 2024-09-14T07:10:25.394 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:Total 439 kB/s | 85 kB 00:00 2024-09-14T07:10:25.395 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:25.401 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:25.401 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:25.407 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:25.465 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:25.514 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:25.699 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:25.855 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:26.066 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:26.096 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:26.097 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:26.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados2 2024-09-14T07:10:26.325 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:26.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:26.325 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:26.325 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:26.325 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:26.325 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:26.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2024-09-14T07:10:26.830 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:26.920 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:26.964 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:26.965 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:26.965 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:27.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librbd1 2024-09-14T07:10:27.176 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:27.314 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:27.315 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:27.315 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-14T07:10:27.315 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:27.315 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:27.315 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.2 M 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 14 M 2024-09-14T07:10:27.316 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:27.588 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:27.630 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2024-09-14T07:10:27.630 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:27.631 INFO:teuthology.orchestra.run.smithi071.stdout:Total 10 MB/s | 3.2 MB 00:00 2024-09-14T07:10:27.631 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:27.640 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:27.640 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:27.678 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:27.720 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:27.721 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:27.721 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:27.722 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:27.723 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:27.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rados 2024-09-14T07:10:28.162 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:28.256 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:10:28.256 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T07:10:28.256 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T07:10:28.256 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T07:10:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:28.346 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:28.437 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:28.480 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:28.481 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:28.481 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:28.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rgw 2024-09-14T07:10:29.105 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:29.194 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:29.237 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:29.238 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:29.238 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:29.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-cephfs 2024-09-14T07:10:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:29.388 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:29.388 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:29.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2024-09-14T07:10:29.870 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:29.961 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:30.004 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:30.005 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:30.005 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:30.069 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rbd 2024-09-14T07:10:30.196 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:54 ago on Sat 14 Sep 2024 07:08:36 AM UTC. 2024-09-14T07:10:30.331 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-14T07:10:30.332 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-14T07:10:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-14T07:10:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 171 k 2024-09-14T07:10:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 490 k 2024-09-14T07:10:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-14T07:10:30.549 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 791 kB/s | 171 kB 00:00 2024-09-14T07:10:30.549 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:30.549 INFO:teuthology.orchestra.run.smithi071.stdout:Total 787 kB/s | 171 kB 00:00 2024-09-14T07:10:30.549 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-14T07:10:30.557 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-14T07:10:30.557 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-14T07:10:30.620 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-14T07:10:30.621 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-14T07:10:30.637 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:30.726 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T07:10:30.773 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:30.774 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-09-14T07:10:30.774 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:30.779 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-14T07:10:30.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-fuse 2024-09-14T07:10:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:31.313 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:31.397 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:31.529 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:31.530 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:31.530 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-09-14T07:10:31.530 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:31.530 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 85 k 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 231 k 2024-09-14T07:10:31.531 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:31.570 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:31.570 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:31.570 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-14T07:10:31.571 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:31.571 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:31.571 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-14T07:10:31.721 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 448 kB/s | 85 kB 00:00 2024-09-14T07:10:31.721 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:31.721 INFO:teuthology.orchestra.run.smithi086.stdout:Total 445 kB/s | 85 kB 00:00 2024-09-14T07:10:31.722 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:31.728 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:31.728 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:31.791 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:31.792 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:31.819 DEBUG:teuthology.parallel:result is None 2024-09-14T07:10:31.938 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:32.035 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:32.393 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:32.663 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:32.663 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:32.663 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:32.663 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:32.664 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:32.664 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:32.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-mirror 2024-09-14T07:10:33.461 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:55 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:33.595 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:33.596 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 3.2 M 2024-09-14T07:10:33.597 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 14 M 2024-09-14T07:10:33.597 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:33.931 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.5 MB/s | 3.2 MB 00:00 2024-09-14T07:10:33.932 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:33.932 INFO:teuthology.orchestra.run.smithi086.stdout:Total 9.5 MB/s | 3.2 MB 00:00 2024-09-14T07:10:33.932 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:34.024 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:34.024 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:34.478 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:34.691 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T07:10:34.691 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T07:10:34.691 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T07:10:34.691 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T07:10:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:35.621 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:35.621 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:35.621 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:35.621 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:35.621 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:35.622 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:35.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-nbd 2024-09-14T07:10:36.437 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:58 ago on Sat 14 Sep 2024 07:08:38 AM UTC. 2024-09-14T07:10:36.573 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T07:10:36.574 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-09-14T07:10:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:36.575 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 171 k 2024-09-14T07:10:36.575 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 490 k 2024-09-14T07:10:36.575 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T07:10:36.792 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 789 kB/s | 171 kB 00:00 2024-09-14T07:10:36.792 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T07:10:36.793 INFO:teuthology.orchestra.run.smithi086.stdout:Total 782 kB/s | 171 kB 00:00 2024-09-14T07:10:36.793 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T07:10:36.800 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T07:10:36.801 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T07:10:36.866 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T07:10:36.866 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T07:10:37.031 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T07:10:37.140 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:37.566 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T07:10:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:37.845 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T07:10:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T07:10:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:37.845 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T07:10:38.061 DEBUG:teuthology.parallel:result is None 2024-09-14T07:10:38.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T07:10:38.203 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T07:10:38.229 INFO:teuthology.orchestra.run.smithi071.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T07:10:38.229 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T07:10:38.230 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T07:10:38.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T07:10:38.370 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T07:10:38.392 INFO:teuthology.orchestra.run.smithi086.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T07:10:38.392 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T07:10:38.392 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T07:10:38.394 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T07:10:38.394 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:38.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T07:10:38.425 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:38.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T07:10:38.458 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T07:10:38.458 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:38.459 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T07:10:38.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T07:10:38.562 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:38.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T07:10:38.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T07:10:38.653 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T07:10:38.653 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:38.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T07:10:38.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T07:10:38.747 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:38.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T07:10:38.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T07:10:38.859 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T07:10:38.859 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:38.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T07:10:38.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T07:10:38.954 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:38.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T07:10:38.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T07:10:39.043 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T07:10:39.121 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T07:10:39.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-09-14T07:10:39.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-09-14T07:10:39.149 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T07:10:39.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T07:10:39.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T07:10:39.215 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T07:10:39.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T07:10:39.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T07:10:39.291 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T07:10:39.291 INFO:tasks.ceph:config {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T07:10:39.292 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423', 'branch': 'main', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900423', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5839, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'sleep_before_teardown': 0, 'subset': '99/128', 'suite': 'rbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDepkAFLByUhrYL02WC5b3b+/a4fTQe2ilMrxmtKQz3KaQdGCYcJMuUKtfygH4nPYBMVoGKcP7MKRD4JYEYWUvo=', 'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNh4AVTRy0J3dZRQwnInJE4MB+GMYWZMMplJSKUhs4a+gaQDjb3w/4zw/fIGaZAJRT9PLBIB2g5I0KEuM6D7fUU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_20:16:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T07:10:39.292 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T07:10:39.323 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T07:10:39.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T07:10:39.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T07:10:39.403 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:39.403 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T07:10:39.458 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T07:10:39.458 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 07:10:28.496366197 +0000 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 07:07:53.658232917 +0000 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 07:07:53.658232917 +0000 2024-09-14T07:10:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-14 07:07:53.658232917 +0000 2024-09-14T07:10:39.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T07:10:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T07:10:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T07:10:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000171116 s, 3.0 MB/s 2024-09-14T07:10:39.577 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T07:10:39.633 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 07:10:28.496366197 +0000 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 07:07:53.979227516 +0000 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 07:07:53.979227516 +0000 2024-09-14T07:10:39.688 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-14 07:07:53.979227516 +0000 2024-09-14T07:10:39.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T07:10:39.751 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T07:10:39.751 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T07:10:39.751 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000206502 s, 2.5 MB/s 2024-09-14T07:10:39.752 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T07:10:39.809 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 07:10:28.496366197 +0000 2024-09-14T07:10:39.864 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 07:07:54.305222031 +0000 2024-09-14T07:10:39.865 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 07:07:54.305222031 +0000 2024-09-14T07:10:39.865 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-14 07:07:54.305222031 +0000 2024-09-14T07:10:39.865 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T07:10:39.927 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T07:10:39.927 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T07:10:39.927 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00022476 s, 2.3 MB/s 2024-09-14T07:10:39.928 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T07:10:39.985 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 07:10:28.497366181 +0000 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 07:07:54.624216664 +0000 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 07:07:54.624216664 +0000 2024-09-14T07:10:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-14 07:07:54.624216664 +0000 2024-09-14T07:10:40.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T07:10:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T07:10:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T07:10:40.103 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000163664 s, 3.1 MB/s 2024-09-14T07:10:40.104 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T07:10:40.160 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:40.160 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:40.160 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T07:10:40.179 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T07:10:40.179 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-14T07:10:40.236 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T07:10:40.236 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 07:10:34.933425371 +0000 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 07:08:00.652890624 +0000 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 07:08:00.652890624 +0000 2024-09-14T07:10:40.237 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 07:08:00.652890624 +0000 2024-09-14T07:10:40.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T07:10:40.303 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T07:10:40.303 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T07:10:40.303 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000275789 s, 1.9 MB/s 2024-09-14T07:10:40.304 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T07:10:40.363 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-14T07:10:40.419 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T07:10:40.419 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 07:10:34.933425371 +0000 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 07:08:00.976883397 +0000 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 07:08:00.976883397 +0000 2024-09-14T07:10:40.420 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 07:08:00.976883397 +0000 2024-09-14T07:10:40.420 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T07:10:40.484 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T07:10:40.484 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T07:10:40.484 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000271828 s, 1.9 MB/s 2024-09-14T07:10:40.485 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T07:10:40.543 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-14T07:10:40.598 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 07:10:34.933425371 +0000 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 07:08:01.304876080 +0000 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 07:08:01.304876080 +0000 2024-09-14T07:10:40.599 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 07:08:01.304876080 +0000 2024-09-14T07:10:40.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T07:10:40.663 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T07:10:40.663 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T07:10:40.663 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000214431 s, 2.4 MB/s 2024-09-14T07:10:40.664 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T07:10:40.721 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-14T07:10:40.777 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 07:10:34.934425349 +0000 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 07:08:01.644868496 +0000 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 07:08:01.644868496 +0000 2024-09-14T07:10:40.778 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 07:08:01.644868496 +0000 2024-09-14T07:10:40.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T07:10:40.841 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T07:10:40.841 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T07:10:40.841 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000208549 s, 2.5 MB/s 2024-09-14T07:10:40.842 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T07:10:40.898 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:40.899 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T07:10:40.899 INFO:tasks.ceph:Generating config... 2024-09-14T07:10:40.900 INFO:tasks.ceph:[client] rbd qos iops burst = 100 2024-09-14T07:10:40.900 INFO:tasks.ceph:[client] rbd qos iops limit = 50 2024-09-14T07:10:40.900 INFO:tasks.ceph:[client] rbd qos schedule tick min = 100 2024-09-14T07:10:40.901 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T07:10:40.901 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T07:10:40.901 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T07:10:40.901 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T07:10:40.901 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T07:10:40.901 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T07:10:40.901 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T07:10:40.901 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T07:10:40.901 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-09-14T07:10:40.901 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-09-14T07:10:40.901 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T07:10:40.901 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T07:10:40.901 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T07:10:40.902 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-14T07:10:40.903 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T07:10:40.903 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-14T07:10:40.903 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T07:10:40.903 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T07:10:40.903 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T07:10:40.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T07:10:40.964 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T07:10:40.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T07:10:41.014 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T07:10:41.040 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.c', '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]'), ('mon.b', '172.21.15.86')] 2024-09-14T07:10:41.040 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.86', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T07:10:41.041 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:41.041 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T07:10:41.095 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --addv c '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]' --add b 172.21.15.86 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 589dc63d-1bfc-48bf-bb57-35804a598e44 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 589dc63d-1bfc-48bf-bb57-35804a598e44 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2024-09-14T07:10:41.183151+0000 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-14T07:10:41.183151+0000 2024-09-14T07:10:41.183 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 17 (quincy) 2024-09-14T07:10:41.184 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2024-09-14T07:10:41.184 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T07:10:41.184 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T07:10:41.184 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T07:10:41.184 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T07:10:41.185 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T07:10:41.200 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 589dc63d-1bfc-48bf-bb57-35804a598e44... 2024-09-14T07:10:41.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T07:10:41.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.283 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-09-14T07:10:41.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.285 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.86" 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: mon client directed command retry = 5 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on pool no app = False 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject socket failures = 5000 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 589dc63d-1bfc-48bf-bb57-35804a598e44 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.286 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-09-14T07:10:41.287 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-09-14T07:10:41.288 INFO:teuthology.orchestra.run.smithi071.stdout: bluefs allocator = hybrid 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = hybrid 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: osd blocked scrub grace period = 3600 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-09-14T07:10:41.289 INFO:teuthology.orchestra.run.smithi071.stdout: osd max markdown count = 1000 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: osd shutdown pgref assert = True 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-09-14T07:10:41.290 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.291 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T07:10:41.292 INFO:teuthology.orchestra.run.smithi071.stdout: rbd qos iops burst = 100 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi071.stdout: rbd qos iops limit = 50 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi071.stdout: rbd qos schedule tick min = 100 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T07:10:41.293 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-14T07:10:41.294 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-14T07:10:41.295 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.86" 2024-09-14T07:10:41.296 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on pool no app = False 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 5000 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 589dc63d-1bfc-48bf-bb57-35804a598e44 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-14T07:10:41.297 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.298 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: bluefs allocator = hybrid 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = hybrid 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-14T07:10:41.299 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: osd shutdown pgref assert = True 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-14T07:10:41.300 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-14T07:10:41.301 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-14T07:10:41.302 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: rbd qos iops burst = 100 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: rbd qos iops limit = 50 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout: rbd qos schedule tick min = 100 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-14T07:10:41.303 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-14T07:10:41.305 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T07:10:41.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T07:10:41.399 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T07:10:41.400 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:41.400 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T07:10:41.415 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:41.415 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T07:10:41.470 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:10:41.470 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:41.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T07:10:41.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T07:10:41.544 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:10:41.545 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:41.600 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:10:41.600 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:41.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T07:10:41.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T07:10:41.635 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:10:41.635 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:41.691 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T07:10:41.691 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T07:10:41.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T07:10:41.741 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T07:10:41.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T07:10:41.828 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T07:10:41.831 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T07:10:41.831 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T07:10:41.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T07:10:41.873 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T07:10:41.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T07:10:41.926 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T07:10:41.939 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T07:10:41.939 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T07:10:41.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T07:10:41.963 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:41.963 INFO:tasks.ceph:role: osd.0 2024-09-14T07:10:41.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:10:41.964 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T07:10:42.035 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:10:42.035 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:10:42.035 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:10:42.036 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:10:42.036 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:10:42.036 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:10:42.036 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:10:42.036 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:10:42.036 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:10:42.037 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:10:42.552 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T07:10:42.554 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T07:10:42.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T07:10:42.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T07:10:42.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T07:10:42.807 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:42.807 INFO:tasks.ceph:role: osd.1 2024-09-14T07:10:42.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:10:42.808 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T07:10:42.880 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:10:42.880 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:10:42.880 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:10:42.880 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:10:42.880 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:10:42.881 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:10:42.881 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:10:42.881 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:10:42.881 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:10:42.881 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:10:43.329 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T07:10:43.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T07:10:43.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T07:10:43.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T07:10:43.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T07:10:43.522 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:43.522 INFO:tasks.ceph:role: osd.2 2024-09-14T07:10:43.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:10:43.522 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:10:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:10:43.595 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:10:44.081 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T07:10:44.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T07:10:44.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T07:10:44.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T07:10:44.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T07:10:44.329 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:44.329 INFO:tasks.ceph:role: osd.3 2024-09-14T07:10:44.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:10:44.330 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T07:10:44.401 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:10:44.402 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:10:44.919 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T07:10:44.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T07:10:44.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T07:10:45.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T07:10:45.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:45.198+0000 7f4be8210640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T07:10:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:45.199+0000 7f4be8210640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T07:10:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:45.199+0000 7f4be8210640 -1 bdev(0x55e7eddd1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T07:10:45.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:45.199+0000 7f4be8210640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T07:10:48.600 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T07:10:48.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:48.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:48.718+0000 7f77f4e0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T07:10:48.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:48.719+0000 7f77f4e0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T07:10:48.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:48.719+0000 7f77f4e0f640 -1 bdev(0x558714dbf800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T07:10:48.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:48.719+0000 7f77f4e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T07:10:52.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T07:10:52.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:52.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:52.247+0000 7f7f7e414640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T07:10:52.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:52.248+0000 7f7f7e414640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T07:10:52.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:52.248+0000 7f7f7e414640 -1 bdev(0x55b650241800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T07:10:52.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:52.248+0000 7f7f7e414640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T07:10:55.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T07:10:55.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:10:55.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:55.531+0000 7f17d06d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T07:10:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:55.531+0000 7f17d06d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T07:10:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:55.531+0000 7f17d06d6640 -1 bdev(0x55b195e23800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T07:10:55.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T07:10:55.532+0000 7f17d06d6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T07:10:58.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T07:10:58.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T07:10:59.003 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:59.003 INFO:tasks.ceph:role: osd.4 2024-09-14T07:10:59.003 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:10:59.003 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T07:10:59.079 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:10:59.080 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:10:59.606 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T07:10:59.608 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T07:10:59.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T07:10:59.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T07:10:59.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T07:10:59.838 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T07:10:59.838 INFO:tasks.ceph:role: osd.5 2024-09-14T07:10:59.838 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:10:59.838 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:10:59.912 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:10:59.913 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:10:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:10:59.913 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:11:00.366 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T07:11:00.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T07:11:00.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T07:11:00.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T07:11:00.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T07:11:00.588 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T07:11:00.588 INFO:tasks.ceph:role: osd.6 2024-09-14T07:11:00.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:11:00.588 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T07:11:00.661 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:11:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:11:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:11:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:11:00.661 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:11:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:11:00.662 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:11:00.662 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:11:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:11:00.662 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:11:01.166 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T07:11:01.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T07:11:01.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T07:11:01.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T07:11:01.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T07:11:01.405 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T07:11:01.405 INFO:tasks.ceph:role: osd.7 2024-09-14T07:11:01.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:11:01.406 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T07:11:01.480 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T07:11:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T07:11:01.481 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T07:11:01.991 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T07:11:01.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T07:11:01.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T07:11:02.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T07:11:02.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:11:02.302 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:02.301+0000 7fcccf813640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T07:11:02.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:02.301+0000 7fcccf813640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T07:11:02.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:02.301+0000 7fcccf813640 -1 bdev(0x55aae837f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T07:11:02.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:02.301+0000 7fcccf813640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T07:11:05.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T07:11:05.499 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:11:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:05.589+0000 7fb24651b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T07:11:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:05.590+0000 7fb24651b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T07:11:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:05.590+0000 7fb24651b640 -1 bdev(0x55ad57fa1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T07:11:05.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:05.590+0000 7fb24651b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T07:11:08.499 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T07:11:08.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:11:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:08.617+0000 7efd89026640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T07:11:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:08.617+0000 7efd89026640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T07:11:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:08.617+0000 7efd89026640 -1 bdev(0x562653ce9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T07:11:08.618 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:08.617+0000 7efd89026640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T07:11:11.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T07:11:11.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:11:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:11.641+0000 7f1f8c1cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T07:11:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:11.641+0000 7f1f8c1cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T07:11:11.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:11.641+0000 7f1f8c1cc640 -1 bdev(0x55fcaf397800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T07:11:11.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T07:11:11.641+0000 7f1f8c1cc640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T07:11:14.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T07:11:14.595 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T07:11:14.595 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:14.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T07:11:14.625 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:14.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T07:11:14.694 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:14.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T07:11:14.763 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:14.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T07:11:14.830 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:14.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T07:11:14.897 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:14.897 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T07:11:14.927 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:14.927 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T07:11:14.996 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:14.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T07:11:15.065 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:15.065 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T07:11:15.132 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:15.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T07:11:15.198 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:15.198 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T07:11:15.216 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:15.216 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T07:11:15.255 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T07:11:15.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T07:11:15.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T07:11:15.298 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-09-14T07:11:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDxNuVmOhc0LBAAkYXHR4o/xjinnAj1BFO4Eg== 2024-09-14T07:11:15.298 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-09-14T07:11:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD1NuVmLtXpCxAAHWLtAaZ7u4O//aCCZkdDmA== 2024-09-14T07:11:15.298 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD4NuVmtDfpKhAA3YBxyKSDPKYkawbrDYE5gw== 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD8NuVmmprlDhAAMeUnR30ESNlahtjAstOJXA== 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD/NuVmnN29HxAAynF2CmJDPda4q2k8FwXf7g== 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDxNuVmhTFnMRAAvVKQTR9SPWaGpLFTZC1MIw== 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAGN+VmCz0DEhAAOXoNlkPGsuBcNAqkSwdAyg== 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAJN+Vm5eI3IxAA3BNiQxZG6VFZnIQds/VndA== 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-09-14T07:11:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAMN+VmscfZJBAACpLo5etuN8QO1FUrU6Sp8Q== 2024-09-14T07:11:15.300 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-09-14T07:11:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAPN+VmQK5JJhAAf/UBQJUC3v4yvzCCZqAiXQ== 2024-09-14T07:11:15.300 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-14T07:11:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDxNuVmOMILNBAAWiI+IWhbKUIxAZHGRmYD5A== 2024-09-14T07:11:15.300 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-09-14T07:11:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDxNuVmCRA+NxAAArkIPi/Sw+Xy6h2Yi3xA8w== 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDxNuVmOhc0LBAAkYXHR4o/xjinnAj1BFO4Eg== 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD1NuVmLtXpCxAAHWLtAaZ7u4O//aCCZkdDmA== 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD4NuVmtDfpKhAA3YBxyKSDPKYkawbrDYE5gw== 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD8NuVmmprlDhAAMeUnR30ESNlahtjAstOJXA== 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-09-14T07:11:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD/NuVmnN29HxAAynF2CmJDPda4q2k8FwXf7g== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDxNuVmhTFnMRAAvVKQTR9SPWaGpLFTZC1MIw== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAGN+VmCz0DEhAAOXoNlkPGsuBcNAqkSwdAyg== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAJN+Vm5eI3IxAA3BNiQxZG6VFZnIQds/VndA== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAMN+VmscfZJBAACpLo5etuN8QO1FUrU6Sp8Q== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAPN+VmQK5JJhAAf/UBQJUC3v4yvzCCZqAiXQ== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDxNuVmOMILNBAAWiI+IWhbKUIxAZHGRmYD5A== 2024-09-14T07:11:15.320 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2024-09-14T07:11:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDxNuVmCRA+NxAAArkIPi/Sw+Xy6h2Yi3xA8w== 2024-09-14T07:11:15.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T07:11:15.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T07:11:15.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T07:11:15.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T07:11:15.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T07:11:15.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T07:11:15.897 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T07:11:15.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T07:11:15.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T07:11:16.008 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T07:11:16.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T07:11:16.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T07:11:16.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T07:11:16.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T07:11:16.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T07:11:16.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T07:11:16.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T07:11:16.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T07:11:16.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T07:11:16.487 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:11:16.490 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T07:11:16.541 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T07:11:16.542 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T07:11:16.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T07:11:16.545 INFO:tasks.ceph.mon.a:Started 2024-09-14T07:11:16.545 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T07:11:16.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T07:11:16.547 INFO:tasks.ceph.mon.c:Started 2024-09-14T07:11:16.547 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T07:11:16.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T07:11:16.584 INFO:tasks.ceph.mon.b:Started 2024-09-14T07:11:16.584 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T07:11:16.584 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T07:11:16.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T07:11:16.587 INFO:tasks.ceph.mgr.y:Started 2024-09-14T07:11:16.587 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T07:11:16.587 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T07:11:16.589 INFO:tasks.ceph.mgr.x:Started 2024-09-14T07:11:16.589 DEBUG:tasks.ceph:set 0 configs 2024-09-14T07:11:16.589 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T07:11:16.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T07:11:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-09-14T07:11:22.778 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T07:11:22.778 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T07:11:22.778 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:22.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T07:11:22.802 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:22.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T07:11:22.868 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:22.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T07:11:22.934 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T07:11:22.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T07:11:22.999 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:23.000 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T07:11:23.024 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:23.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T07:11:23.089 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:23.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T07:11:23.154 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T07:11:23.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T07:11:23.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new baa123cb-89ef-45b4-8952-ad69f57110ad 0 2024-09-14T07:11:23.510 INFO:teuthology.orchestra.run.smithi086.stdout:0 2024-09-14T07:11:23.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new d521eb0c-ea3e-46c6-8e5c-262df62043ab 1 2024-09-14T07:11:23.699 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-14T07:11:23.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 089f22b2-6c41-4854-af61-bb916f617ef5 2 2024-09-14T07:11:23.887 INFO:teuthology.orchestra.run.smithi086.stdout:2 2024-09-14T07:11:23.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 5a8d365e-a098-4d07-9927-647c4fc0b3da 3 2024-09-14T07:11:24.077 INFO:teuthology.orchestra.run.smithi086.stdout:3 2024-09-14T07:11:24.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 13920f12-491b-4330-a5a2-fbf6c6f5242f 4 2024-09-14T07:11:24.270 INFO:teuthology.orchestra.run.smithi086.stdout:4 2024-09-14T07:11:24.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 5c838ac4-0108-4981-bdee-8a6ae76e1f22 5 2024-09-14T07:11:24.475 INFO:teuthology.orchestra.run.smithi086.stdout:5 2024-09-14T07:11:24.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new e9aacee6-d441-4987-addf-617339375ef0 6 2024-09-14T07:11:24.665 INFO:teuthology.orchestra.run.smithi086.stdout:6 2024-09-14T07:11:24.676 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 9e53e2c5-d137-442a-8ee8-9f8757a8e601 7 2024-09-14T07:11:24.882 INFO:teuthology.orchestra.run.smithi086.stdout:7 2024-09-14T07:11:24.894 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T07:11:24.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T07:11:24.896 INFO:tasks.ceph.osd.0:Started 2024-09-14T07:11:24.896 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T07:11:24.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T07:11:24.898 INFO:tasks.ceph.osd.1:Started 2024-09-14T07:11:24.899 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T07:11:24.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T07:11:24.901 INFO:tasks.ceph.osd.2:Started 2024-09-14T07:11:24.901 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T07:11:24.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T07:11:24.903 INFO:tasks.ceph.osd.3:Started 2024-09-14T07:11:24.903 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T07:11:24.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T07:11:24.906 INFO:tasks.ceph.osd.4:Started 2024-09-14T07:11:24.906 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T07:11:24.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T07:11:24.908 INFO:tasks.ceph.osd.5:Started 2024-09-14T07:11:24.909 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T07:11:24.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T07:11:24.911 INFO:tasks.ceph.osd.6:Started 2024-09-14T07:11:24.911 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T07:11:24.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T07:11:24.913 INFO:tasks.ceph.osd.7:Started 2024-09-14T07:11:24.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T07:11:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:25.102 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:11:24.880196+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T07:11:24.880196+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:11:25.113 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T07:11:25.113 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T07:11:25.918 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T07:11:26.089 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-14T07:11:26.089 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:11:24.880196+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T07:11:24.880196+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:11:26.099 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T07:11:26.354 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:26.353+0000 7fcf9a1cc640 -1 Falling back to public interface 2024-09-14T07:11:26.372 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:26.371+0000 7f18633c5640 -1 Falling back to public interface 2024-09-14T07:11:26.378 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:26.377+0000 7fe7fde2f640 -1 Falling back to public interface 2024-09-14T07:11:26.387 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:26.386+0000 7f28c6b2b640 -1 Falling back to public interface 2024-09-14T07:11:26.388 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:26.388+0000 7f19b0c15640 -1 Falling back to public interface 2024-09-14T07:11:26.641 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:26.640+0000 7f373e624640 -1 Falling back to public interface 2024-09-14T07:11:26.645 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:26.644+0000 7f539dbc3640 -1 Falling back to public interface 2024-09-14T07:11:26.646 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:26.645+0000 7f00cca0d640 -1 Falling back to public interface 2024-09-14T07:11:27.345 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-09-14T07:11:27.344+0000 7f2d9c617640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T07:11:27.345 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-09-14T07:11:27.344+0000 7f2d9c617640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T07:11:30.114 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:30.113+0000 7fcf9a1cc640 -1 osd.7 0 log_to_monitors true 2024-09-14T07:11:30.166 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:30.165+0000 7f28c6b2b640 -1 osd.3 0 log_to_monitors true 2024-09-14T07:11:30.195 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:30.195+0000 7f18633c5640 -1 osd.6 0 log_to_monitors true 2024-09-14T07:11:30.216 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:30.215+0000 7f19b0c15640 -1 osd.4 0 log_to_monitors true 2024-09-14T07:11:30.216 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:30.215+0000 7fe7fde2f640 -1 osd.1 0 log_to_monitors true 2024-09-14T07:11:30.668 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:30.667+0000 7f373e624640 -1 osd.5 0 log_to_monitors true 2024-09-14T07:11:30.749 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:30.748+0000 7f539dbc3640 -1 osd.0 0 log_to_monitors true 2024-09-14T07:11:30.980 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:30.979+0000 7f00cca0d640 -1 osd.2 0 log_to_monitors true 2024-09-14T07:11:32.906 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T07:11:33.325 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-14T07:11:33.326 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":13,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:11:32.873344+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T07:11:24.880196+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:11:33.341 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T07:11:33.867 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:33.866+0000 7fe7f9dbe640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T07:11:33.882 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:33.881+0000 7fe7f1bdd640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:33.906 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:33.905+0000 7f28c2aba640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T07:11:33.923 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:33.922+0000 7f28ba8d9640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:33.933 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:33.932+0000 7f5399b52640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T07:11:33.949 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:33.948+0000 7f5391971640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:34.025 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:34.024+0000 7f185f354640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T07:11:34.043 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:34.042+0000 7f1857173640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:34.068 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:34.068+0000 7f373a5b3640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T07:11:34.085 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:34.084+0000 7f37323d2640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:34.115 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:34.114+0000 7fcf9615b640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T07:11:34.126 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:34.126+0000 7f19ac4f5640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T07:11:34.127 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:34.126+0000 7fcf8df7a640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:34.141 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:34.140+0000 7f19a4314640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:34.166 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:34.165+0000 7f00c8c5f640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T07:11:34.183 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:34.182+0000 7f00c026a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:11:40.148 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T07:11:40.426 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-14T07:11:40.426 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":18,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:11:39.131141+0000","last_up_change":"2024-09-14T07:11:34.872507+0000","last_in_change":"2024-09-14T07:11:24.880196+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T07:11:36.356620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889617493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889617493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6829","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6831","nonce":2889617493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6825","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6827","nonce":2889617493}]},"public_addr":"172.21.15.71:6819/2889617493","cluster_addr":"172.21.15.71:6823/2889617493","heartbeat_back_addr":"172.21.15.71:6831/2889617493","heartbeat_front_addr":"172.21.15.71:6827/2889617493","state":["exists","up"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6803","nonce":3955072152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6805","nonce":3955072152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6809","nonce":3955072152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6807","nonce":3955072152}]},"public_addr":"172.21.15.71:6803/3955072152","cluster_addr":"172.21.15.71:6805/3955072152","heartbeat_back_addr":"172.21.15.71:6809/3955072152","heartbeat_front_addr":"172.21.15.71:6807/3955072152","state":["exists","up"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6822","nonce":3066758971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6826","nonce":3066758971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6833","nonce":3066758971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6830","nonce":3066758971}]},"public_addr":"172.21.15.71:6822/3066758971","cluster_addr":"172.21.15.71:6826/3066758971","heartbeat_back_addr":"172.21.15.71:6833/3066758971","heartbeat_front_addr":"172.21.15.71:6830/3066758971","state":["exists","up"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6811","nonce":1876512586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6813","nonce":1876512586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6817","nonce":1876512586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6815","nonce":1876512586}]},"public_addr":"172.21.15.71:6811/1876512586","cluster_addr":"172.21.15.71:6813/1876512586","heartbeat_back_addr":"172.21.15.71:6817/1876512586","heartbeat_front_addr":"172.21.15.71:6815/1876512586","state":["exists","up"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6817","nonce":1898851107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6819","nonce":1898851107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6823","nonce":1898851107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6821","nonce":1898851107}]},"public_addr":"172.21.15.86:6817/1898851107","cluster_addr":"172.21.15.86:6819/1898851107","heartbeat_back_addr":"172.21.15.86:6823/1898851107","heartbeat_front_addr":"172.21.15.86:6821/1898851107","state":["exists","up"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6825","nonce":1385217108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6827","nonce":1385217108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6831","nonce":1385217108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6829","nonce":1385217108}]},"public_addr":"172.21.15.86:6825/1385217108","cluster_addr":"172.21.15.86:6827/1385217108","heartbeat_back_addr":"172.21.15.86:6831/1385217108","heartbeat_front_addr":"172.21.15.86:6829/1385217108","state":["exists","up"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6809","nonce":1465682528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6811","nonce":1465682528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6815","nonce":1465682528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6813","nonce":1465682528}]},"public_addr":"172.21.15.86:6809/1465682528","cluster_addr":"172.21.15.86:6811/1465682528","heartbeat_back_addr":"172.21.15.86:6815/1465682528","heartbeat_front_addr":"172.21.15.86:6813/1465682528","state":["exists","up"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6801","nonce":2849091451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6803","nonce":2849091451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6807","nonce":2849091451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6805","nonce":2849091451}]},"public_addr":"172.21.15.86:6801/2849091451","cluster_addr":"172.21.15.86:6803/2849091451","heartbeat_back_addr":"172.21.15.86:6807/2849091451","heartbeat_front_addr":"172.21.15.86:6805/2849091451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.746971+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.202992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:32.026889+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.140575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.188928+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.701967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.242666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.149131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:11:40.437 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T07:11:40.437 INFO:tasks.ceph:Creating RBD pool 2024-09-14T07:11:40.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T07:11:41.147 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2024-09-14T07:11:41.167 DEBUG:teuthology.orchestra.run.smithi071:> rbd --cluster ceph pool init rbd 2024-09-14T07:11:44.179 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T07:11:44.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T07:11:44.181 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T07:11:44.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:44.487 INFO:teuthology.orchestra.run.smithi071.stdout:[{"version":9,"timestamp":"2024-09-14T07:11:34.166958+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5227.438605"}]}] 2024-09-14T07:11:44.487 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T07:11:44.488 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T07:11:44.488 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T07:11:44.488 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T07:11:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:44.833 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":816002458},{"type":"v1","addr":"172.21.15.71:6801","nonce":816002458}]},"active_addr":"172.21.15.71:6801/816002458","active_change":"2024-09-14T07:11:26.333117+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":2735253334}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":2619283118}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1786592762}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":125895213}]}]} 2024-09-14T07:11:44.837 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T07:11:44.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T07:11:44.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T07:11:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:45.124 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:11:44.157830+0000","last_up_change":"2024-09-14T07:11:34.872507+0000","last_in_change":"2024-09-14T07:11:24.880196+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T07:11:36.356620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T07:11:40.724021+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889617493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889617493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6829","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6831","nonce":2889617493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6825","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6827","nonce":2889617493}]},"public_addr":"172.21.15.71:6819/2889617493","cluster_addr":"172.21.15.71:6823/2889617493","heartbeat_back_addr":"172.21.15.71:6831/2889617493","heartbeat_front_addr":"172.21.15.71:6827/2889617493","state":["exists","up"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6803","nonce":3955072152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6805","nonce":3955072152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6809","nonce":3955072152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6807","nonce":3955072152}]},"public_addr":"172.21.15.71:6803/3955072152","cluster_addr":"172.21.15.71:6805/3955072152","heartbeat_back_addr":"172.21.15.71:6809/3955072152","heartbeat_front_addr":"172.21.15.71:6807/3955072152","state":["exists","up"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6822","nonce":3066758971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6826","nonce":3066758971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6833","nonce":3066758971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6830","nonce":3066758971}]},"public_addr":"172.21.15.71:6822/3066758971","cluster_addr":"172.21.15.71:6826/3066758971","heartbeat_back_addr":"172.21.15.71:6833/3066758971","heartbeat_front_addr":"172.21.15.71:6830/3066758971","state":["exists","up"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6811","nonce":1876512586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6813","nonce":1876512586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6817","nonce":1876512586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6815","nonce":1876512586}]},"public_addr":"172.21.15.71:6811/1876512586","cluster_addr":"172.21.15.71:6813/1876512586","heartbeat_back_addr":"172.21.15.71:6817/1876512586","heartbeat_front_addr":"172.21.15.71:6815/1876512586","state":["exists","up"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6817","nonce":1898851107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6819","nonce":1898851107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6823","nonce":1898851107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6821","nonce":1898851107}]},"public_addr":"172.21.15.86:6817/1898851107","cluster_addr":"172.21.15.86:6819/1898851107","heartbeat_back_addr":"172.21.15.86:6823/1898851107","heartbeat_front_addr":"172.21.15.86:6821/1898851107","state":["exists","up"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6825","nonce":1385217108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6827","nonce":1385217108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6831","nonce":1385217108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6829","nonce":1385217108}]},"public_addr":"172.21.15.86:6825/1385217108","cluster_addr":"172.21.15.86:6827/1385217108","heartbeat_back_addr":"172.21.15.86:6831/1385217108","heartbeat_front_addr":"172.21.15.86:6829/1385217108","state":["exists","up"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6809","nonce":1465682528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6811","nonce":1465682528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6815","nonce":1465682528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6813","nonce":1465682528}]},"public_addr":"172.21.15.86:6809/1465682528","cluster_addr":"172.21.15.86:6811/1465682528","heartbeat_back_addr":"172.21.15.86:6815/1465682528","heartbeat_front_addr":"172.21.15.86:6813/1465682528","state":["exists","up"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6801","nonce":2849091451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6803","nonce":2849091451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6807","nonce":2849091451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6805","nonce":2849091451}]},"public_addr":"172.21.15.86:6801/2849091451","cluster_addr":"172.21.15.86:6803/2849091451","heartbeat_back_addr":"172.21.15.86:6807/2849091451","heartbeat_front_addr":"172.21.15.86:6805/2849091451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.746971+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.202992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:32.026889+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.140575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.188928+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.701967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.242666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.149131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:11:45.137 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T07:11:45.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T07:11:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:45.422 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:11:44.157830+0000","last_up_change":"2024-09-14T07:11:34.872507+0000","last_in_change":"2024-09-14T07:11:24.880196+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T07:11:36.356620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T07:11:40.724021+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889617493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889617493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6829","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6831","nonce":2889617493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6825","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6827","nonce":2889617493}]},"public_addr":"172.21.15.71:6819/2889617493","cluster_addr":"172.21.15.71:6823/2889617493","heartbeat_back_addr":"172.21.15.71:6831/2889617493","heartbeat_front_addr":"172.21.15.71:6827/2889617493","state":["exists","up"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6803","nonce":3955072152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6805","nonce":3955072152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6809","nonce":3955072152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6807","nonce":3955072152}]},"public_addr":"172.21.15.71:6803/3955072152","cluster_addr":"172.21.15.71:6805/3955072152","heartbeat_back_addr":"172.21.15.71:6809/3955072152","heartbeat_front_addr":"172.21.15.71:6807/3955072152","state":["exists","up"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6822","nonce":3066758971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6826","nonce":3066758971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6833","nonce":3066758971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6830","nonce":3066758971}]},"public_addr":"172.21.15.71:6822/3066758971","cluster_addr":"172.21.15.71:6826/3066758971","heartbeat_back_addr":"172.21.15.71:6833/3066758971","heartbeat_front_addr":"172.21.15.71:6830/3066758971","state":["exists","up"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6811","nonce":1876512586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6813","nonce":1876512586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6817","nonce":1876512586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6815","nonce":1876512586}]},"public_addr":"172.21.15.71:6811/1876512586","cluster_addr":"172.21.15.71:6813/1876512586","heartbeat_back_addr":"172.21.15.71:6817/1876512586","heartbeat_front_addr":"172.21.15.71:6815/1876512586","state":["exists","up"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6817","nonce":1898851107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6819","nonce":1898851107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6823","nonce":1898851107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6821","nonce":1898851107}]},"public_addr":"172.21.15.86:6817/1898851107","cluster_addr":"172.21.15.86:6819/1898851107","heartbeat_back_addr":"172.21.15.86:6823/1898851107","heartbeat_front_addr":"172.21.15.86:6821/1898851107","state":["exists","up"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6825","nonce":1385217108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6827","nonce":1385217108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6831","nonce":1385217108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":1385217108},{"type":"v1","addr":"172.21.15.86:6829","nonce":1385217108}]},"public_addr":"172.21.15.86:6825/1385217108","cluster_addr":"172.21.15.86:6827/1385217108","heartbeat_back_addr":"172.21.15.86:6831/1385217108","heartbeat_front_addr":"172.21.15.86:6829/1385217108","state":["exists","up"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6809","nonce":1465682528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6811","nonce":1465682528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6815","nonce":1465682528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6813","nonce":1465682528}]},"public_addr":"172.21.15.86:6809/1465682528","cluster_addr":"172.21.15.86:6811/1465682528","heartbeat_back_addr":"172.21.15.86:6815/1465682528","heartbeat_front_addr":"172.21.15.86:6813/1465682528","state":["exists","up"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6801","nonce":2849091451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6803","nonce":2849091451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6807","nonce":2849091451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6805","nonce":2849091451}]},"public_addr":"172.21.15.86:6801/2849091451","cluster_addr":"172.21.15.86:6803/2849091451","heartbeat_back_addr":"172.21.15.86:6807/2849091451","heartbeat_front_addr":"172.21.15.86:6805/2849091451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.746971+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.202992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:32.026889+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.140575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.188928+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.701967+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.242666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.149131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:11:45.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T07:11:45.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T07:11:45.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T07:11:45.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T07:11:45.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T07:11:45.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T07:11:45.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T07:11:45.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T07:11:45.676 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:45.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T07:11:45.678 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:45.679 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:45.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T07:11:45.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T07:11:45.681 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T07:11:45.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T07:11:45.682 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:45.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T07:11:45.684 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T07:11:45.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T07:11:45.685 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T07:11:45.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T07:11:45.686 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:45.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T07:11:46.214 INFO:teuthology.orchestra.run.smithi071.stdout:60129542147 2024-09-14T07:11:46.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.1 2024-09-14T07:11:46.279 INFO:teuthology.orchestra.run.smithi071.stdout:60129542147 2024-09-14T07:11:46.289 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T07:11:46.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.0 2024-09-14T07:11:46.302 INFO:teuthology.orchestra.run.smithi071.stdout:60129542147 2024-09-14T07:11:46.304 INFO:teuthology.orchestra.run.smithi071.stdout:60129542147 2024-09-14T07:11:46.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2024-09-14T07:11:46.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.2 2024-09-14T07:11:46.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-09-14T07:11:46.328 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T07:11:46.330 INFO:teuthology.orchestra.run.smithi071.stdout:60129542147 2024-09-14T07:11:46.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2024-09-14T07:11:46.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.7 2024-09-14T07:11:46.347 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T07:11:46.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2024-09-14T07:11:47.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T07:11:47.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T07:11:47.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T07:11:47.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T07:11:47.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T07:11:47.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T07:11:47.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T07:11:47.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T07:11:47.757 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:47.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-14T07:11:47.778 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T07:11:47.858 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:47.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-14T07:11:47.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-14T07:11:47.876 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.876 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.905 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:47.917 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T07:11:47.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-14T07:11:47.919 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.924 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:47.929 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T07:11:47.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-14T07:11:47.933 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-14T07:11:47.939 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-14T07:11:47.943 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.957 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T07:11:47.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-14T07:11:47.971 DEBUG:teuthology.parallel:result is None 2024-09-14T07:11:47.971 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T07:11:47.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:11:48.294 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:11:48.306 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T07:11:46.340214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219192,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755528,"statfs":{"total":773094113280,"available":772869660672,"internally_reserved":0,"allocated":2998272,"data_stored":1795734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.191993"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285521+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:11:44.285521+0000","last_peered":"2024-09-14T07:11:44.285521+0000","last_clean":"2024-09-14T07:11:44.285521+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:11:44.285521+0000","last_undegraded":"2024-09-14T07:11:44.285521+0000","last_fullsized":"2024-09-14T07:11:44.285521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167216+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:11:44.167216+0000","last_peered":"2024-09-14T07:11:44.167216+0000","last_clean":"2024-09-14T07:11:44.167216+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:11:44.167216+0000","last_undegraded":"2024-09-14T07:11:44.167216+0000","last_fullsized":"2024-09-14T07:11:44.167216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285467+0000","last_change":"2024-09-14T07:11:44.285467+0000","last_active":"2024-09-14T07:11:44.285467+0000","last_peered":"2024-09-14T07:11:44.285467+0000","last_clean":"2024-09-14T07:11:44.285467+0000","last_became_active":"2024-09-14T07:11:42.522259+0000","last_became_peered":"2024-09-14T07:11:42.522259+0000","last_unstale":"2024-09-14T07:11:44.285467+0000","last_undegraded":"2024-09-14T07:11:44.285467+0000","last_fullsized":"2024-09-14T07:11:44.285467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:36.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050089199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167316+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:11:44.167316+0000","last_peered":"2024-09-14T07:11:44.167316+0000","last_clean":"2024-09-14T07:11:44.167316+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:11:44.167316+0000","last_undegraded":"2024-09-14T07:11:44.167316+0000","last_fullsized":"2024-09-14T07:11:44.167316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.174170+0000","last_change":"2024-09-14T07:11:44.173496+0000","last_active":"2024-09-14T07:11:44.174170+0000","last_peered":"2024-09-14T07:11:44.174170+0000","last_clean":"2024-09-14T07:11:44.174170+0000","last_became_active":"2024-09-14T07:11:42.160139+0000","last_became_peered":"2024-09-14T07:11:42.160139+0000","last_unstale":"2024-09-14T07:11:44.174170+0000","last_undegraded":"2024-09-14T07:11:44.174170+0000","last_fullsized":"2024-09-14T07:11:44.174170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:06.385105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098001300000000006,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.166883+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:11:44.166883+0000","last_peered":"2024-09-14T07:11:44.166883+0000","last_clean":"2024-09-14T07:11:44.166883+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:11:44.166883+0000","last_undegraded":"2024-09-14T07:11:44.166883+0000","last_fullsized":"2024-09-14T07:11:44.166883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285465+0000","last_change":"2024-09-14T07:11:44.285465+0000","last_active":"2024-09-14T07:11:44.285465+0000","last_peered":"2024-09-14T07:11:44.285465+0000","last_clean":"2024-09-14T07:11:44.285465+0000","last_became_active":"2024-09-14T07:11:42.161743+0000","last_became_peered":"2024-09-14T07:11:42.161743+0000","last_unstale":"2024-09-14T07:11:44.285465+0000","last_undegraded":"2024-09-14T07:11:44.285465+0000","last_fullsized":"2024-09-14T07:11:44.285465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:48.837628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000438577,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.173001+0000","last_change":"2024-09-14T07:11:44.173001+0000","last_active":"2024-09-14T07:11:44.173001+0000","last_peered":"2024-09-14T07:11:44.173001+0000","last_clean":"2024-09-14T07:11:44.173001+0000","last_became_active":"2024-09-14T07:11:42.162986+0000","last_became_peered":"2024-09-14T07:11:42.162986+0000","last_unstale":"2024-09-14T07:11:44.173001+0000","last_undegraded":"2024-09-14T07:11:44.173001+0000","last_fullsized":"2024-09-14T07:11:44.173001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:31.147223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047133599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.284850+0000","last_change":"2024-09-14T07:11:38.798176+0000","last_active":"2024-09-14T07:11:44.284850+0000","last_peered":"2024-09-14T07:11:44.284850+0000","last_clean":"2024-09-14T07:11:44.284850+0000","last_became_active":"2024-09-14T07:11:38.796999+0000","last_became_peered":"2024-09-14T07:11:38.796999+0000","last_unstale":"2024-09-14T07:11:44.284850+0000","last_undegraded":"2024-09-14T07:11:44.284850+0000","last_fullsized":"2024-09-14T07:11:44.284850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:26.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:11:48.307 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:11:48.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:48.584 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:11:48.595 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T07:11:48.340583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219192,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755528,"statfs":{"total":773094113280,"available":772869660672,"internally_reserved":0,"allocated":2998272,"data_stored":1795734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.187405"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285521+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:11:44.285521+0000","last_peered":"2024-09-14T07:11:44.285521+0000","last_clean":"2024-09-14T07:11:44.285521+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:11:44.285521+0000","last_undegraded":"2024-09-14T07:11:44.285521+0000","last_fullsized":"2024-09-14T07:11:44.285521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167216+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:11:44.167216+0000","last_peered":"2024-09-14T07:11:44.167216+0000","last_clean":"2024-09-14T07:11:44.167216+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:11:44.167216+0000","last_undegraded":"2024-09-14T07:11:44.167216+0000","last_fullsized":"2024-09-14T07:11:44.167216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285467+0000","last_change":"2024-09-14T07:11:44.285467+0000","last_active":"2024-09-14T07:11:44.285467+0000","last_peered":"2024-09-14T07:11:44.285467+0000","last_clean":"2024-09-14T07:11:44.285467+0000","last_became_active":"2024-09-14T07:11:42.522259+0000","last_became_peered":"2024-09-14T07:11:42.522259+0000","last_unstale":"2024-09-14T07:11:44.285467+0000","last_undegraded":"2024-09-14T07:11:44.285467+0000","last_fullsized":"2024-09-14T07:11:44.285467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:36.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050089199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167316+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:11:44.167316+0000","last_peered":"2024-09-14T07:11:44.167316+0000","last_clean":"2024-09-14T07:11:44.167316+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:11:44.167316+0000","last_undegraded":"2024-09-14T07:11:44.167316+0000","last_fullsized":"2024-09-14T07:11:44.167316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.174170+0000","last_change":"2024-09-14T07:11:44.173496+0000","last_active":"2024-09-14T07:11:44.174170+0000","last_peered":"2024-09-14T07:11:44.174170+0000","last_clean":"2024-09-14T07:11:44.174170+0000","last_became_active":"2024-09-14T07:11:42.160139+0000","last_became_peered":"2024-09-14T07:11:42.160139+0000","last_unstale":"2024-09-14T07:11:44.174170+0000","last_undegraded":"2024-09-14T07:11:44.174170+0000","last_fullsized":"2024-09-14T07:11:44.174170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:06.385105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098001300000000006,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.166883+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:11:44.166883+0000","last_peered":"2024-09-14T07:11:44.166883+0000","last_clean":"2024-09-14T07:11:44.166883+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:11:44.166883+0000","last_undegraded":"2024-09-14T07:11:44.166883+0000","last_fullsized":"2024-09-14T07:11:44.166883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285465+0000","last_change":"2024-09-14T07:11:44.285465+0000","last_active":"2024-09-14T07:11:44.285465+0000","last_peered":"2024-09-14T07:11:44.285465+0000","last_clean":"2024-09-14T07:11:44.285465+0000","last_became_active":"2024-09-14T07:11:42.161743+0000","last_became_peered":"2024-09-14T07:11:42.161743+0000","last_unstale":"2024-09-14T07:11:44.285465+0000","last_undegraded":"2024-09-14T07:11:44.285465+0000","last_fullsized":"2024-09-14T07:11:44.285465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:48.837628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000438577,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.173001+0000","last_change":"2024-09-14T07:11:44.173001+0000","last_active":"2024-09-14T07:11:44.173001+0000","last_peered":"2024-09-14T07:11:44.173001+0000","last_clean":"2024-09-14T07:11:44.173001+0000","last_became_active":"2024-09-14T07:11:42.162986+0000","last_became_peered":"2024-09-14T07:11:42.162986+0000","last_unstale":"2024-09-14T07:11:44.173001+0000","last_undegraded":"2024-09-14T07:11:44.173001+0000","last_fullsized":"2024-09-14T07:11:44.173001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:31.147223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047133599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.284850+0000","last_change":"2024-09-14T07:11:38.798176+0000","last_active":"2024-09-14T07:11:44.284850+0000","last_peered":"2024-09-14T07:11:44.284850+0000","last_clean":"2024-09-14T07:11:44.284850+0000","last_became_active":"2024-09-14T07:11:38.796999+0000","last_became_peered":"2024-09-14T07:11:38.796999+0000","last_unstale":"2024-09-14T07:11:44.284850+0000","last_undegraded":"2024-09-14T07:11:44.284850+0000","last_fullsized":"2024-09-14T07:11:44.284850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:26.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:11:48.596 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T07:11:48.597 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T07:11:48.597 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T07:11:48.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T07:11:48.914 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:48.914 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T07:11:48.927 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T07:11:48.927 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-14T07:11:48.938 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-14T07:11:48.938 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-14T07:11:48.938 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-14T07:11:48.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-14T07:11:49.242 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-14T07:11:49.243 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T07:11:49.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:11:49.523 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:11:49.535 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T07:11:48.340583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219192,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755528,"statfs":{"total":773094113280,"available":772869660672,"internally_reserved":0,"allocated":2998272,"data_stored":1795734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.187405"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285521+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:11:44.285521+0000","last_peered":"2024-09-14T07:11:44.285521+0000","last_clean":"2024-09-14T07:11:44.285521+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:11:44.285521+0000","last_undegraded":"2024-09-14T07:11:44.285521+0000","last_fullsized":"2024-09-14T07:11:44.285521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167216+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:11:44.167216+0000","last_peered":"2024-09-14T07:11:44.167216+0000","last_clean":"2024-09-14T07:11:44.167216+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:11:44.167216+0000","last_undegraded":"2024-09-14T07:11:44.167216+0000","last_fullsized":"2024-09-14T07:11:44.167216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285467+0000","last_change":"2024-09-14T07:11:44.285467+0000","last_active":"2024-09-14T07:11:44.285467+0000","last_peered":"2024-09-14T07:11:44.285467+0000","last_clean":"2024-09-14T07:11:44.285467+0000","last_became_active":"2024-09-14T07:11:42.522259+0000","last_became_peered":"2024-09-14T07:11:42.522259+0000","last_unstale":"2024-09-14T07:11:44.285467+0000","last_undegraded":"2024-09-14T07:11:44.285467+0000","last_fullsized":"2024-09-14T07:11:44.285467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:36.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050089199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167316+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:11:44.167316+0000","last_peered":"2024-09-14T07:11:44.167316+0000","last_clean":"2024-09-14T07:11:44.167316+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:11:44.167316+0000","last_undegraded":"2024-09-14T07:11:44.167316+0000","last_fullsized":"2024-09-14T07:11:44.167316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.174170+0000","last_change":"2024-09-14T07:11:44.173496+0000","last_active":"2024-09-14T07:11:44.174170+0000","last_peered":"2024-09-14T07:11:44.174170+0000","last_clean":"2024-09-14T07:11:44.174170+0000","last_became_active":"2024-09-14T07:11:42.160139+0000","last_became_peered":"2024-09-14T07:11:42.160139+0000","last_unstale":"2024-09-14T07:11:44.174170+0000","last_undegraded":"2024-09-14T07:11:44.174170+0000","last_fullsized":"2024-09-14T07:11:44.174170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:06.385105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098001300000000006,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.166883+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:11:44.166883+0000","last_peered":"2024-09-14T07:11:44.166883+0000","last_clean":"2024-09-14T07:11:44.166883+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:11:44.166883+0000","last_undegraded":"2024-09-14T07:11:44.166883+0000","last_fullsized":"2024-09-14T07:11:44.166883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285465+0000","last_change":"2024-09-14T07:11:44.285465+0000","last_active":"2024-09-14T07:11:44.285465+0000","last_peered":"2024-09-14T07:11:44.285465+0000","last_clean":"2024-09-14T07:11:44.285465+0000","last_became_active":"2024-09-14T07:11:42.161743+0000","last_became_peered":"2024-09-14T07:11:42.161743+0000","last_unstale":"2024-09-14T07:11:44.285465+0000","last_undegraded":"2024-09-14T07:11:44.285465+0000","last_fullsized":"2024-09-14T07:11:44.285465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:48.837628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000438577,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.173001+0000","last_change":"2024-09-14T07:11:44.173001+0000","last_active":"2024-09-14T07:11:44.173001+0000","last_peered":"2024-09-14T07:11:44.173001+0000","last_clean":"2024-09-14T07:11:44.173001+0000","last_became_active":"2024-09-14T07:11:42.162986+0000","last_became_peered":"2024-09-14T07:11:42.162986+0000","last_unstale":"2024-09-14T07:11:44.173001+0000","last_undegraded":"2024-09-14T07:11:44.173001+0000","last_fullsized":"2024-09-14T07:11:44.173001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:31.147223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047133599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.284850+0000","last_change":"2024-09-14T07:11:38.798176+0000","last_active":"2024-09-14T07:11:44.284850+0000","last_peered":"2024-09-14T07:11:44.284850+0000","last_clean":"2024-09-14T07:11:44.284850+0000","last_became_active":"2024-09-14T07:11:38.796999+0000","last_became_peered":"2024-09-14T07:11:38.796999+0000","last_unstale":"2024-09-14T07:11:44.284850+0000","last_undegraded":"2024-09-14T07:11:44.284850+0000","last_fullsized":"2024-09-14T07:11:44.284850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:26.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:11:49.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:11:49.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:49.816 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:11:49.828 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T07:11:48.340583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219192,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755528,"statfs":{"total":773094113280,"available":772869660672,"internally_reserved":0,"allocated":2998272,"data_stored":1795734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.187405"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285521+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:11:44.285521+0000","last_peered":"2024-09-14T07:11:44.285521+0000","last_clean":"2024-09-14T07:11:44.285521+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:11:44.285521+0000","last_undegraded":"2024-09-14T07:11:44.285521+0000","last_fullsized":"2024-09-14T07:11:44.285521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167216+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:11:44.167216+0000","last_peered":"2024-09-14T07:11:44.167216+0000","last_clean":"2024-09-14T07:11:44.167216+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:11:44.167216+0000","last_undegraded":"2024-09-14T07:11:44.167216+0000","last_fullsized":"2024-09-14T07:11:44.167216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285467+0000","last_change":"2024-09-14T07:11:44.285467+0000","last_active":"2024-09-14T07:11:44.285467+0000","last_peered":"2024-09-14T07:11:44.285467+0000","last_clean":"2024-09-14T07:11:44.285467+0000","last_became_active":"2024-09-14T07:11:42.522259+0000","last_became_peered":"2024-09-14T07:11:42.522259+0000","last_unstale":"2024-09-14T07:11:44.285467+0000","last_undegraded":"2024-09-14T07:11:44.285467+0000","last_fullsized":"2024-09-14T07:11:44.285467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:36.300436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050089199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.167316+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:11:44.167316+0000","last_peered":"2024-09-14T07:11:44.167316+0000","last_clean":"2024-09-14T07:11:44.167316+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:11:44.167316+0000","last_undegraded":"2024-09-14T07:11:44.167316+0000","last_fullsized":"2024-09-14T07:11:44.167316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.174170+0000","last_change":"2024-09-14T07:11:44.173496+0000","last_active":"2024-09-14T07:11:44.174170+0000","last_peered":"2024-09-14T07:11:44.174170+0000","last_clean":"2024-09-14T07:11:44.174170+0000","last_became_active":"2024-09-14T07:11:42.160139+0000","last_became_peered":"2024-09-14T07:11:42.160139+0000","last_unstale":"2024-09-14T07:11:44.174170+0000","last_undegraded":"2024-09-14T07:11:44.174170+0000","last_fullsized":"2024-09-14T07:11:44.174170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:06.385105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098001300000000006,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.166883+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:11:44.166883+0000","last_peered":"2024-09-14T07:11:44.166883+0000","last_clean":"2024-09-14T07:11:44.166883+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:11:44.166883+0000","last_undegraded":"2024-09-14T07:11:44.166883+0000","last_fullsized":"2024-09-14T07:11:44.166883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.285465+0000","last_change":"2024-09-14T07:11:44.285465+0000","last_active":"2024-09-14T07:11:44.285465+0000","last_peered":"2024-09-14T07:11:44.285465+0000","last_clean":"2024-09-14T07:11:44.285465+0000","last_became_active":"2024-09-14T07:11:42.161743+0000","last_became_peered":"2024-09-14T07:11:42.161743+0000","last_unstale":"2024-09-14T07:11:44.285465+0000","last_undegraded":"2024-09-14T07:11:44.285465+0000","last_fullsized":"2024-09-14T07:11:44.285465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:48.837628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000438577,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.173001+0000","last_change":"2024-09-14T07:11:44.173001+0000","last_active":"2024-09-14T07:11:44.173001+0000","last_peered":"2024-09-14T07:11:44.173001+0000","last_clean":"2024-09-14T07:11:44.173001+0000","last_became_active":"2024-09-14T07:11:42.162986+0000","last_became_peered":"2024-09-14T07:11:42.162986+0000","last_unstale":"2024-09-14T07:11:44.173001+0000","last_undegraded":"2024-09-14T07:11:44.173001+0000","last_fullsized":"2024-09-14T07:11:44.173001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:31.147223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047133599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T07:11:44.284850+0000","last_change":"2024-09-14T07:11:38.798176+0000","last_active":"2024-09-14T07:11:44.284850+0000","last_peered":"2024-09-14T07:11:44.284850+0000","last_clean":"2024-09-14T07:11:44.284850+0000","last_became_active":"2024-09-14T07:11:38.796999+0000","last_became_peered":"2024-09-14T07:11:38.796999+0000","last_unstale":"2024-09-14T07:11:44.284850+0000","last_undegraded":"2024-09-14T07:11:44.284850+0000","last_fullsized":"2024-09-14T07:11:44.284850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:26.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":667238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:11:49.829 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T07:11:49.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-14T07:11:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 22 2024-09-14T07:11:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 589dc63d-1bfc-48bf-bb57-35804a598e44 2024-09-14T07:11:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-14T07:11:21.848766+0000 2024-09-14T07:11:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-14T07:11:44.157830+0000 2024-09-14T07:11:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-14T07:11:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:crush_version 5 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:full_ratio 0.95 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:backfillfull_ratio 0.9 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:nearfull_ratio 0.85 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:require_min_compat_client luminous 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:min_compat_client jewel 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:require_osd_release squid 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:stretch_mode_enabled false 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout: removed_snaps_queue [2~1] 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:max_osd 8 2024-09-14T07:11:50.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6818/2889617493,v1:172.21.15.71:6819/2889617493] [v2:172.21.15.71:6821/2889617493,v1:172.21.15.71:6823/2889617493] exists,up baa123cb-89ef-45b4-8952-ad69f57110ad 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6802/3955072152,v1:172.21.15.71:6803/3955072152] [v2:172.21.15.71:6804/3955072152,v1:172.21.15.71:6805/3955072152] exists,up d521eb0c-ea3e-46c6-8e5c-262df62043ab 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6820/3066758971,v1:172.21.15.71:6822/3066758971] [v2:172.21.15.71:6824/3066758971,v1:172.21.15.71:6826/3066758971] exists,up 089f22b2-6c41-4854-af61-bb916f617ef5 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6810/1876512586,v1:172.21.15.71:6811/1876512586] [v2:172.21.15.71:6812/1876512586,v1:172.21.15.71:6813/1876512586] exists,up 5a8d365e-a098-4d07-9927-647c4fc0b3da 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6816/1898851107,v1:172.21.15.86:6817/1898851107] [v2:172.21.15.86:6818/1898851107,v1:172.21.15.86:6819/1898851107] exists,up 13920f12-491b-4330-a5a2-fbf6c6f5242f 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/1385217108,v1:172.21.15.86:6825/1385217108] [v2:172.21.15.86:6826/1385217108,v1:172.21.15.86:6827/1385217108] exists,up 5c838ac4-0108-4981-bdee-8a6ae76e1f22 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/1465682528,v1:172.21.15.86:6809/1465682528] [v2:172.21.15.86:6810/1465682528,v1:172.21.15.86:6811/1465682528] exists,up e9aacee6-d441-4987-addf-617339375ef0 2024-09-14T07:11:50.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/2849091451,v1:172.21.15.86:6801/2849091451] [v2:172.21.15.86:6802/2849091451,v1:172.21.15.86:6803/2849091451] exists,up 9e53e2c5-d137-442a-8ee8-9f8757a8e601 2024-09-14T07:11:50.125 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6818/2889617493,v1:172.21.15.71:6819/2889617493] [v2:172.21.15.71:6821/2889617493,v1:172.21.15.71:6823/2889617493] exists,up baa123cb-89ef-45b4-8952-ad69f57110ad', 'osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6802/3955072152,v1:172.21.15.71:6803/3955072152] [v2:172.21.15.71:6804/3955072152,v1:172.21.15.71:6805/3955072152] exists,up d521eb0c-ea3e-46c6-8e5c-262df62043ab', 'osd.2 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6820/3066758971,v1:172.21.15.71:6822/3066758971] [v2:172.21.15.71:6824/3066758971,v1:172.21.15.71:6826/3066758971] exists,up 089f22b2-6c41-4854-af61-bb916f617ef5', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6810/1876512586,v1:172.21.15.71:6811/1876512586] [v2:172.21.15.71:6812/1876512586,v1:172.21.15.71:6813/1876512586] exists,up 5a8d365e-a098-4d07-9927-647c4fc0b3da', 'osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6816/1898851107,v1:172.21.15.86:6817/1898851107] [v2:172.21.15.86:6818/1898851107,v1:172.21.15.86:6819/1898851107] exists,up 13920f12-491b-4330-a5a2-fbf6c6f5242f', 'osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/1385217108,v1:172.21.15.86:6825/1385217108] [v2:172.21.15.86:6826/1385217108,v1:172.21.15.86:6827/1385217108] exists,up 5c838ac4-0108-4981-bdee-8a6ae76e1f22', 'osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/1465682528,v1:172.21.15.86:6809/1465682528] [v2:172.21.15.86:6810/1465682528,v1:172.21.15.86:6811/1465682528] exists,up e9aacee6-d441-4987-addf-617339375ef0', 'osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/2849091451,v1:172.21.15.86:6801/2849091451] [v2:172.21.15.86:6802/2849091451,v1:172.21.15.86:6803/2849091451] exists,up 9e53e2c5-d137-442a-8ee8-9f8757a8e601'] 2024-09-14T07:11:50.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mon.a", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster": "ceph", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "admin_socket_mode": "", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_client_required": "cephx, none", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_cluster_required": "cephx", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_debug": "true", 2024-09-14T07:11:50.224 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_service_required": "cephx", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_supported": "cephx", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio": "true", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_poll_ms": "250", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_reap_max": "16", 2024-09-14T07:11:50.225 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_async_discard_threads": "0", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_block_size": "4096", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio": "false", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_inflight_ios": "false", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_enable_discard": "false", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_flock_retry": "3", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_inject_crash": "0", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_ioring": "false", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_ioring_hipri": "false", 2024-09-14T07:11:50.226 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_type": "", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_alloc_size": "1048576", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_allocator": "hybrid", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_buffered_io": "true", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_check_for_zeros": "false", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_compact_log_sync": "false", 2024-09-14T07:11:50.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_max_log_runway": "4194304", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_max_prefetch": "1048576", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_min_flush_size": "524288", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_min_log_runway": "1048576", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_replay_recovery": "false", 2024-09-14T07:11:50.228 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_sync_write": "false", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_allocation_from_file": "true", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_allocator": "hybrid", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_async_db_compaction": "true", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-14T07:11:50.229 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bdev_label_multi": "true", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_create": "true", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_create": "false", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_path": "", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_size": "0", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_path": "", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_preallocate_file": "false", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_size": "107374182400", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_create": "false", 2024-09-14T07:11:50.230 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_path": "", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_size": "100663296", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs": "true", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T07:11:50.231 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_autotune": "true", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-14T07:11:50.232 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size": "0", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_type": "2q", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_clone_cow": "true", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-14T07:11:50.233 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_mode": "none", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_csum_type": "crc32c", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_freelist": "false", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-14T07:11:50.234 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_small_allocations": "0", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_default_buffered_read": "true", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_default_buffered_write": "false", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-14T07:11:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fail_eio": "false", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-14T07:11:50.236 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mount": "false", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_umount": "false", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-14T07:11:50.237 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_ignore_data_csum": "false", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_op_age": "5.000000", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_alloc_size": "0", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size": "0", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_deferred_txc": "32", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size": "0", 2024-09-14T07:11:50.238 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_nid_prealloc": "1024", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_retry_disk_reads": "3", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_cf": "true", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-14T07:11:50.239 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_mem": "512", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_tracing": "false", 2024-09-14T07:11:50.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_write_v2": "false", 2024-09-14T07:11:50.241 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_write_v2_random": "false", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_zero_block_detection": "false", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-14T07:11:50.242 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_cluster_require_signatures": "false", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_cluster_require_version": "2", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_require_signatures": "false", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_require_version": "2", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_service_require_signatures": "false", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_service_require_version": "2", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_sign_messages": "true", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "chdir": "", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_acl_type": "", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_asio_thread_count": "2", 2024-09-14T07:11:50.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_cache_mid": "0.750000", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_cache_size": "16384", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_caps_release_delay": "5", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_check_pool_perm": "true", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_force_sync_read": "false", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_getattr_caps": "false", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_inject_features": "", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_inject_tick_delay": "0", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_die_on_failed_remount": "false", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_dirsize_rbytes": "true", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_force_lazyio": "false", 2024-09-14T07:11:50.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_fs": "", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_inject_release_failure": "false", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_max_inline_size": "4096", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mds_namespace": "", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_metadata": "", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_gid": "-1", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_timeout": "300", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_uid": "-1", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mountpoint": "/", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_notify_timeout": "10", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc": "true", 2024-09-14T07:11:50.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_dirty": "104857600", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_objects": "1000", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_size": "209715200", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_target_dirty": "8388608", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_permissions": "true", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_quota": "true", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_quota_df": "true", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_max_bytes": "0", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_max_periods": "4", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_min": "131072", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_reconnect_stale": "false", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_shutdown_timeout": "30", 2024-09-14T07:11:50.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_snapdir": ".snap", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_tick_interval": "1", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_trace": "", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_try_dentry_invalidate": "false", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_use_faked_inos": "false", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_use_random_mds": "false", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog": "false", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog_port": "12201", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_monitors": "default=true", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog": "false", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog_level": "info", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "-", 2024-09-14T07:11:50.247 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_network": "", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_network_interface": "", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_isal": "false", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_level": "5", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_winsize": "-15", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zstd_level": "1", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_alien_op_num_threads": "6", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_stat_interval": "0", 2024-09-14T07:11:50.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_seastar_cpu_cores": "", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_seastar_num_threads": "0", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location_hook": "", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location_hook_timeout": "10", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "daemonize": "false", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "daos_pool": "tank", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_alienstore": "0/5", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_allow_any_pool_priority": "false", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asok": "1/5", 2024-09-14T07:11:50.249 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asok_assert_abort": "false", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asserts_on_shutdown": "true", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_auth": "20/20", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bdev": "1/3", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bluefs": "1/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bluestore": "1/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_buffer": "0/1", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_ceph_dedup": "0/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_ceph_exporter": "1/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_cephfs_mirror": "0/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_cephsqlite": "0/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_client": "0/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_compressor": "1/5", 2024-09-14T07:11:50.250 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_context": "0/1", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crimson_interrupt": "0/5", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crush": "1/1", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crypto": "1/5", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_cyanstore": "0/5", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_deliberately_leak_memory": "false", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_disable_randomized_ping": "false", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_dpdk": "1/5", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_eventtrace": "1/5", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_filer": "0/1", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_filestore": "1/3", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_finisher": "1/1", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_fuse": "1/5", 2024-09-14T07:11:50.251 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_heartbeat_testing_span": "0", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_heartbeatmap": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_javaclient": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_journal": "1/3", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_journaler": "0/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_kstore": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_lockdep": "0/1", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mclock": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_balancer": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_locker": "1/5", 2024-09-14T07:11:50.252 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_log": "1/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_log_expire": "1/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_migrator": "1/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_quiesce": "3/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_memstore": "1/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mgr": "2/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mgrc": "1/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mon": "20/20", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_monc": "0/10", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_ms": "1/1", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_none": "0/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objclass": "0/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objectcacher": "0/5", 2024-09-14T07:11:50.253 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objecter": "0/1", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_optracker": "0/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_osd": "1/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_paxos": "20/20", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_perfcounter": "1/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_prioritycache": "1/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rados": "0/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd": "0/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_mirror": "0/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_pwl": "0/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_replay": "0/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_refs": "0/0", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_reserver": "1/1", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw": "1/5", 2024-09-14T07:11:50.254 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_access": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_datacache": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_dbstore": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_flight": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_notification": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_sync": "1/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rocksdb": "4/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore": "0/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_backref": "0/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_cache": "0/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_cleaner": "0/5", 2024-09-14T07:11:50.255 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_device": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_epm": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_journal": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_lba": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_odata": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_omap": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_onode": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_t": "0/5", 2024-09-14T07:11:50.256 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_tm": "0/5", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_striper": "0/1", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_test": "0/5", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_throttle": "1/1", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_timer": "0/1", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_tp": "0/5", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_trace": "1/5", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "device_failure_prediction_mode": "none", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_graylog": "false", 2024-09-14T07:11:50.257 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_journald": "false", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_stderr": "true", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_syslog": "false", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event_tracing": "false", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_addr": "0.0.0.0", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_cert_file": "", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_http_port": "9926", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_key_file": "", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_prio_limit": "5", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_sort_metrics": "true", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_stats_period": "5", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "fake_statfs_for_testing": "0", 2024-09-14T07:11:50.258 INFO:teuthology.orchestra.run.smithi071.stdout: "fatal_signal_handlers": "true", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filer_max_purge_ops": "10", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filer_max_truncate_ops": "128", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_apply_finisher_threads": "1", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_blackhole": "false", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_btrfs_clone_range": "true", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_btrfs_snap": "true", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_caller_concurrency": "10", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_collect_device_partition_information": "true", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_commit_timeout": "600.000000", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_inject_read_err": "false", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_omap_check": "false", 2024-09-14T07:11:50.259 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_verify_split": "false", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_dump_file": "", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fadvise": "true", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fail_eio": "true", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fd_cache_shards": "16", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fd_cache_size": "128", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fiemap": "false", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fiemap_threshold": "4096", 2024-09-14T07:11:50.260 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_inject_stall": "0", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_parallel": "false", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_trailing": "false", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_writeahead": "false", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_kill_at": "0", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs": "0", 2024-09-14T07:11:50.261 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size": "0", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_merge_threshold": "-10", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_odsync_write": "false", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_backend": "rocksdb", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_backend_path": "", 2024-09-14T07:11:50.262 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_thread_timeout": "60", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_threads": "2", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_punch_hole": "false", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-14T07:11:50.263 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_ops": "50", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_seek_data_hole": "false", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_sloppy_crc": "false", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_splice": "false", 2024-09-14T07:11:50.264 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_split_multiple": "2", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_split_rand_factor": "20", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_update_to": "1000", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_enable": "true", 2024-09-14T07:11:50.265 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_xfs_extsize": "false", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_zfs_snap": "false", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fio_dir": "/tmp/fio", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "589dc63d-1bfc-48bf-bb57-35804a598e44", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_allow_other": "true", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_atomic_o_trunc": "true", 2024-09-14T07:11:50.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_big_writes": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_debug": "false", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_default_permissions": "false", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_disable_pagecache": "false", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_max_write": "0", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_multithreaded": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_require_active_mds": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_set_user_groups": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_splice_move": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_splice_read": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_splice_write": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-14T07:11:50.267 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_use_invalidate_cb": "true", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "gss_target_name": "ceph", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_file": "", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_inject_failure": "0", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_interval": "5", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "host": "smithi071", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-14T07:11:50.268 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "inject_early_sigterm": "false", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "jaeger_agent_port": "6799", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "jaeger_tracing_enable": "false", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_aio": "true", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_align_min_size": "65536", 2024-09-14T07:11:50.269 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_block_align": "true", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_block_size": "4096", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_dio": "true", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_discard": "false", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_force_aio": "false", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_ignore_corruption": "false", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_max_write_bytes": "10485760", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_max_write_entries": "100", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_replay_from": "0", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-14T07:11:50.270 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_write_header_frequency": "0", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_zero_on_create": "false", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_prefetch_periods": "10", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_prezero_periods": "5", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_write_head_interval": "15", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "keyfile": "", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_backend": "rocksdb", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_default_stripe_size": "65536", 2024-09-14T07:11:50.271 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_fsck_on_mount": "false", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_max_bytes": "67108864", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_max_ops": "512", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_nid_prealloc": "1024", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_onode_map_size": "1024", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_sync_submit_transaction": "false", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_sync_transaction": "false", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "librados_thread_count": "2", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "lockdep": "false", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "lockdep_force_backtrace": "false", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "log_coarse_timestamps": "true", 2024-09-14T07:11:50.272 INFO:teuthology.orchestra.run.smithi071.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_flush_on_exit": "false", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_graylog_host": "127.0.0.1", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_graylog_port": "12201", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_max_new": "1000", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_max_recent": "10000", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_stderr_prefix": "", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_stop_at_utilization": "0.970000", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": "true", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_graylog": "false", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_journald": "false", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_stderr": "false", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_syslog": "false", 2024-09-14T07:11:50.273 INFO:teuthology.orchestra.run.smithi071.stdout: "max_rotating_auth_attempts": "10", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_action_on_write_error": "1", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_alternate_name_max": "8192", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_asio_thread_count": "2", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_export_pin": "true", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_dirs": "true", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_interval": "5", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_interval": "10", 2024-09-14T07:11:50.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_max": "-1", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_max_until": "-1", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_merge_size": "50", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_midchunk": "0.300000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_min_start": "0.200000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_minchunk": "0.001000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_mode": "0", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_need_max": "1.200000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_need_min": "0.800000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_overload_epochs": "2", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-14T07:11:50.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_bits": "3", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_size": "10000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_target_decay": "10.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_grace": "15.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_interval": "4.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_mid": "0.700000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-14T07:11:50.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_delay": "0", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_release_free_interval": "10", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_reservation": "0.050000", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_interval": "1", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_threshold": "262144", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-14T07:11:50.277 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_prealloc_inos": "1000", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_connect_bootstrapping": "false", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_damage_table_max_entries": "10000", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_auth_pins": "false", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_frag": "false", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_scatterstat": "false", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_subtrees": "false", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_decay_halflife": "5.000000", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_default_dir_hash": "2", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_defer_session_stale": "true", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_deny_all_reconnect": "false", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_keys_per_op": "16384", 2024-09-14T07:11:50.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_max_commit_size": "10", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_max_entries": "0", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_prefetch": "true", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_on_map": "false", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_early_reply": "true", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_enable_op_tracker": "true", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_enforce_unique_name": "true", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-14T07:11:50.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_random": "true", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_health_summarize_threshold": "10", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-14T07:11:50.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_health_dummy": "false", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_migrator_session_race": "false", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_join_fs": "", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_journal_format": "1", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_create_at": "0", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_dirfrag_at": "0", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_export_at": "0", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_import_at": "0", 2024-09-14T07:11:50.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_expire_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_replay_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_link_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_mdstable_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_openc_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_rename_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_shutdown_at": "0", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_event_large_threshold": "524288", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_events_per_segment": "1024", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_max_events": "-1", 2024-09-14T07:11:50.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_max_segments": "128", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_pause": "false", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_segment_size": "0", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_trim_threshold": "128", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_warn_factor": "2.000000", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_caps_per_client": "1048576", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_completed_flushes": "100000", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_completed_requests": "100000", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_export_size": "20971520", 2024-09-14T07:11:50.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_file_recover": "32", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_files": "64", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_ops": "8192", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_snaps_per_dir": "100", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_metrics_update_interval": "2", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_min_caps_per_client": "100", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_min_caps_working_set": "10000", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_numa_node": "-1", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_complaint_time": "30.000000", 2024-09-14T07:11:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_duration": "600", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_size": "20", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_slow_op_size": "20", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_log_threshold": "5", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_ping_grace": "15", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_ping_interval": "5", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_caps": "30000", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-14T07:11:50.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_warning_threshold": "262144", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_replay_interval": "1.000000", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_root_ino_gid": "0", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_root_ino_uid": "0", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_scrub_stats_review_period": "1", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-14T07:11:50.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_shutdown_check": "0", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_skip_ino": "0", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_max_uid": "4294967294", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_min_uid": "0", 2024-09-14T07:11:50.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_rstat": "false", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_standby_replay_damaged": "false", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_symlink_recovery": "true", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_thrash_exports": "0", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_thrash_fragments": "0", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_tick_interval": "5.000000", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_valgrind_exit": "false", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_verify_backtrace": "1", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_verify_scatter": "false", 2024-09-14T07:11:50.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_wipe_sessions": "false", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool_debug": "false", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_device_bytes": "1073741824", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_page_set": "false", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_page_size": "65536", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_bytes": "134217728", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_messages": "512", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-14T07:11:50.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_disabled_modules": "", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_enable_op_tracker": "true", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_max_pg_creating": "1024", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_max_pg_num_change": "128", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mds_bytes": "134217728", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mds_messages": "128", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mon_bytes": "134217728", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mon_messages": "128", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-14T07:11:50.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_op_history_duration": "600", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_op_history_size": "20", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_op_log_threshold": "5", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_osd_bytes": "536870912", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_osd_messages": "8192", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_pool": "true", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_standby_modules": "true", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_stats_period": "5", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_stats_threshold": "5", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_tick_period": "2", 2024-09-14T07:11:50.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_allow_pool_delete": "true", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_allow_pool_size_one": "true", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_auth_validate_all_caps": "true", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_bytes": "104857600", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_directed_command_retry": "5", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-14T07:11:50.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_parallel": "3", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_log_interval": "1.000000", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_ping_interval": "10.000000", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_target_rank": "-1", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_level": "debug", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_file": "true", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-14T07:11:50.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_journald": "false", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_bootstrap": "false", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_start": "false", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_trim": "true", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cpu_threads": "4", 2024-09-14T07:11:50.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_crush_min_required_version": "hammer", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_daemon_bytes": "419430400", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_avail_crit": "5", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_avail_warn": "5", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_size_warn": "16106127360", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_json": "false", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_transactions": "false", 2024-09-14T07:11:50.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_extra_checks": "false", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_reef": "false", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_squid": "false", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_down_mkfs_grace": "120", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_down_uptime_grace": "60", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_election_default_strategy": "1", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_election_timeout": "5.000000", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-14T07:11:50.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_elector_ping_divisor": "2", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_enable_op_tracker": "true", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_fake_pool_delete": "false", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_force_quorum_join": "false", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_globalid_prealloc": "10000", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_detail_to_clog": "false", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_log_update_period": "5", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_max_detail": "50", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog": "true", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog_interval": "600", 2024-09-14T07:11:50.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_host": "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.86", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_host_override": "", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_initial_members": "", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease": "5.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_full_interval": "50", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_max": "10000", 2024-09-14T07:11:50.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_max_summary": "50", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_log_epochs": "500", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_osd": "10000", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_pg_per_osd": "10000", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_pool_pg_num": "65536", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_force_trim_to": "0", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_skip_sanity": "false", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_memory_autotune": "true", 2024-09-14T07:11:50.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_memory_target": "2147483648", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_beacon_grace": "30", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_digest_period": "5", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_inactive_grace": "60", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_min_osdmap_epochs": "500", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_complaint_time": "30", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_duration": "600", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_size": "20", 2024-09-14T07:11:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_slow_op_size": "20", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_log_threshold": "5", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_in": "false", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-14T07:11:50.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_cache_size": "500", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_down_out_interval": "600", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_force_trim_to": "0", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-14T07:11:50.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_down_reporters": "2", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_report_timeout": "900", 2024-09-14T07:11:50.303 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_stuck_threshold": "60", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-14T07:11:50.304 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_probe_timeout": "2.000000", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_max_change": "0.050000", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_max_osds": "4", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_interval": "86400", 2024-09-14T07:11:50.305 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_max_keys": "100", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_timeout": "300", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_session_timeout": "300", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_smart_report_timeout": "5", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stat_smooth_intervals": "6", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_pool_min_size": "2", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_pool_size": "4", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_debug": "false", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-14T07:11:50.306 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_provider_kill_at": "0", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_requester_kill_at": "0", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_timeout": "60.000000", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_target_pg_per_osd": "100", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_tick_interval": "5", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_timecheck_interval": "300.000000", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_use_min_delay_socket": "false", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_older_version_delay": "604800", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-14T07:11:50.307 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_misplaced": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_older_version": "true", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-14T07:11:50.308 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": "", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_tracing_enabled": "false", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_op_threads": "3", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_cm": "false", 2024-09-14T07:11:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_device_name": "", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_dscp": "96", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_local_gid": "", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_port_num": "1", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_sl": "3", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_support_srq": "true", 2024-09-14T07:11:50.310 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_type": "ib", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_reap_threshold": "5", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_before_connect": "false", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_ipv4": "true", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_ipv6": "false", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_msgr1": "true", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_msgr2": "true", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_port_max": "7568", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_port_min": "6800", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_retry_count": "3", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_retry_delay": "5", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_client": "false", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mds": "false", 2024-09-14T07:11:50.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mgr": "false", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mon": "false", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_osd": "false", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_client_mode": "crc secure", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_cluster_mode": "crc secure", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_cluster_type": "", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_compress_secure": "false", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_connection_idle_timeout": "900", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_connection_ready_timeout": "10", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_crc_data": "true", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_crc_header": "true", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_bad_msg": "false", 2024-09-14T07:11:50.312 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_bug": "true", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_old_message": "true", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_skipped_message": "false", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_coremask": "0xF", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_enable_tso": "true", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hugepages": "", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-14T07:11:50.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_lro": "true", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_memory_channel": "4", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_pmd": "", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_port_id": "0", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dump_on_send": "false", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_initial_backoff": "0.200000", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_max": "1.000000", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_type": "", 2024-09-14T07:11:50.314 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_network_congestion": "0", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_socket_failures": "5000", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_learn_addr_from_peer": "true", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_max_accept_failures": "4", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_max_backoff": "15.000000", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_client_mode": "secure crc", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_service_mode": "secure crc", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_osd_compress_min_size": "1024", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_osd_compress_mode": "none", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-14T07:11:50.315 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_pq_min_cost": "65536", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_public_type": "", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_service_mode": "crc secure", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_listen_backlog": "512", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_nodelay": "true", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_rcvbuf": "0", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_type": "async+posix", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "no_config_file": "false", 2024-09-14T07:11:50.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_completion_locks_per_session": "32", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inflight_ops": "1024", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_tick_interval": "5.000000", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_timeout": "10.000000", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objectstore_blackhole": "false", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "openssl_engine_opts": "", 2024-09-14T07:11:50.317 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_delay_time": "5.000000", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_hist_halflife": "1000", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_max_low_ops": "2", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_max_ops": "4", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_slop": "0.020000", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_asio_thread_count": "2", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_async_recovery_min_cost": "100", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_scan_max": "512", 2024-09-14T07:11:50.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_scan_min": "64", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_degraded": "false", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_peering": "false", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_unfound": "true", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_beacon_report_interval": "300", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_duration": "30", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_max_block_size": "67108864", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_blkin_trace_all": "false", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-14T07:11:50.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_check_for_log_corruption": "false", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_update_on_start": "true", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_message_cap": "256", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_message_size_cap": "524288000", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_op_priority": "63", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_watch_timeout": "30", 2024-09-14T07:11:50.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_command_max_records": "256", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_compact_on_start": "false", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_update_on_start": "true", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_update_weight_set": "true", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-14T07:11:50.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_feed_pullee": "-1", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_misdirected_ops": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_no_acting_change": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_no_purge_strays": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_op_order": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_shutdown": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-14T07:11:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_trim_objects": "false", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_snaps": "false", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_keys": "1024", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-14T07:11:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_stride": "524288", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_default_notify_timeout": "30", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep": "0.000000", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_discard_disconnected_ops": "true", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_ec_partial_reads": "true", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_enable_op_tracker": "true", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-14T07:11:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_info": "true", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown": "true", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_function_tracing": "false", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_grace": "20", 2024-09-14T07:11:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_interval": "6", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_peers": "10", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_size": "2000", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_stale": "600", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_max_size": "100000", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_min_size": "1000", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-14T07:11:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal_size": "5120", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_kill_backfill_at": "0", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_cache_size": "50", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_dedup": "true", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_message_max": "40", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_share_max_epochs": "40", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_attr_name_len": "100", 2024-09-14T07:11:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_attr_size": "0", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_backfills": "1", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_markdown_count": "5", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_markdown_period": "600", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_name_len": "2048", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_namespace_len": "256", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_size": "134217728", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_blocked_by": "16", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_log_entries": "10000", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pgls": "1024", 2024-09-14T07:11:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_push_cost": "8388608", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_push_objects": "10", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_scrubs": "3", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_trimming_pgs": "2", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_write_op_reply_len": "64", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_write_size": "90", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-14T07:11:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_profile": "balanced", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-14T07:11:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-14T07:11:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-14T07:11:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-14T07:11:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-14T07:11:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-14T07:11:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_base": "805306368", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_cache_min": "134217728", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target": "4294967296", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target_autotune": "false", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_min_pg_log_entries": "250", 2024-09-14T07:11:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_min_recovery_priority": "0", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_report_interval": "5", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_num_cache_shards": "32", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_num_op_tracker_shard": "32", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_auto_affinity": "true", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_node": "-1", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_prefer_iface": "true", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-14T07:11:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objecter_finishers": "1", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore": "bluestore", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_fuse": "false", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_tracing": "false", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_complaint_time": "30.000000", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_duration": "600", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_size": "20", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_slow_op_size": "20", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_log_threshold": "5", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards": "0", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards_hdd": "5", 2024-09-14T07:11:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards_ssd": "8", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_pq_min_cost": "65536", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_queue_cut_off": "high", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_thread_timeout": "15", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_open_classes_on_start": "true", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_os_flags": "0", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_peering_op_priority": "255", 2024-09-14T07:11:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_delete_cost": "1048576", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_delete_priority": "5", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_trim_max": "10000", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_trim_min": "100", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-14T07:11:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_crimson": "false", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-14T07:11:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flags": "0", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_min_size": "0", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pg_num": "32", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pgp_num": "0", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_read_ratio": "70", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_size": "2", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_type": "replicated", 2024-09-14T07:11:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_push_per_object_cost": "1000", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recover_clone_overlap": "true", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_cost": "20971520", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active": "0", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-14T07:11:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_single_start": "1", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_op_priority": "3", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_priority": "5", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep": "0.000000", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_repair_during_recovery": "false", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_requested_scrub_priority": "120", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-14T07:11:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_auto_repair": "false", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_begin_hour": "0", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_begin_week_day": "0", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_chunk_max": "25", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_chunk_min": "5", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_cost": "52428800", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_during_recovery": "false", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_end_hour": "0", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_end_week_day": "0", 2024-09-14T07:11:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_event_cost": "4096", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_invalid_stats": "true", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_max_preemptions": "5", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_priority": "5", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_sleep": "0.000000", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-14T07:11:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_skip_data_digest": "false", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_smart_report_timeout": "5", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_cost": "1048576", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_priority": "5", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-14T07:11:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_target_transaction_size": "30", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tracing": "false", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_use_stale_snap": "false", 2024-09-14T07:11:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "osdc_blkin_trace_all": "false", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_kill_at": "0", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_max_join_drift": "10", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_min": "500", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_min_wait": "0.050000", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_propose_interval": "1.000000", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_max": "500", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_min": "250", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_stash_full_interval": "25", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_trim_max": "500", 2024-09-14T07:11:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_trim_min": "250", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "perf": "true", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "-", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrv": "", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_bind_addr": "-", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_network": "", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_network_interface": "", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "qat_compressor_busy_polling": "false", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "qat_compressor_enabled": "false", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "qat_compressor_session_max_number": "256", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_mon_op_timeout": "0", 2024-09-14T07:11:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_osd_op_timeout": "0", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_tracing": "false", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_atime_update_interval": "60", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_balance_parent_reads": "false", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_balance_snap_reads": "false", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blkin_trace_all": "false", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache": "true", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-14T07:11:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_policy": "writearound", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_size": "33554432", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_clone_copy_on_read": "false", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_compression_hint": "none", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_concurrent_management_ops": "10", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_clone_format": "auto", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_data_pool": "", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_features": "61", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_format": "2", 2024-09-14T07:11:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_map_options": "", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_order": "22", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_pool": "rbd", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_stripe_count": "0", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_stripe_unit": "0", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_enable_alloc_hint": "true", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_io_scheduler": "simple", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-14T07:11:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_order": "24", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_pool": "", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_splay_width": "4", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_localize_parent_reads": "false", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_localize_snap_reads": "false", 2024-09-14T07:11:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-14T07:11:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-14T07:11:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mtime_update_interval": "60", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_non_blocking_aio": "true", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_op_thread_timeout": "60", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_op_threads": "1", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_parent_cache_enabled": "false", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-14T07:11:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_plugins": "", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_burst": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_limit": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_exclude_ops": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_burst": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_limit": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-14T07:11:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_read_from_replica_policy": "default", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-14T07:11:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_skip_partial_discard": "true", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_tracing": "false", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_validate_names": "true", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_validate_pool": "true", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "restapi_base_url": "", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "restapi_log_level": "", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_acl_grants_max_num": "100", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_admin_entry": "admin", 2024-09-14T07:11:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_asio_assert_yielding": "false", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_backend_store": "rados", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_barbican_url": "", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_beast_enable_async": "true", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_counters_cache": "false", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-14T07:11:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_enabled": "true", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_expiry_interval": "900", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_lru_size": "25000", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_config_store": "rados", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_content_length_compat": "false", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_copy_obj_progress": "true", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cors_rules_max_num": "100", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cross_domain_policy": "", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-14T07:11:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_addr": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_password": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_username": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_require_ssl": "true", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-14T07:11:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_addr": "", 2024-09-14T07:11:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_auth": "token", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_namespace": "", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_prefix": "", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_token_file": "", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_buffersize": "524288", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_low_speed_time": "300", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-14T07:11:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-14T07:11:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_changes_size": "1000", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_num_shards": "128", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_window": "30", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-14T07:11:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_disable_s3select": "false", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-14T07:11:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dns_name": "", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dns_s3website_name": "", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dynamic_resharding": "true", 2024-09-14T07:11:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_gc_threads": "true", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_lc_threads": "true", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_mdsearch": "true", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_ops_log": "false", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_quota_threads": "true", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_static_website": "false", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_usage_log": "false", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enforce_swift_acls": "true", 2024-09-14T07:11:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_exit_timeout_secs": "120", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_expose_bucket": "false", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_extended_http_attrs": "", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_filter": "none", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_frontends": "beast port=7480", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_deferred": "50", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_objs": "32", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-14T07:11:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_processor_period": "3600", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_init_timeout": "300", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_kafka_connection_idle": "300", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-14T07:11:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_domain": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_password": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_password_path": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_project": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_tenant": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_token": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_token_path": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_user": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_domain": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_password": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_project": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-14T07:11:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_user": "", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_url": "", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_debug_interval": "-1", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_lock_max_time": "90", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_objs": "32", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_rules": "1000", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_worker": "3", 2024-09-14T07:11:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_thread_delay": "0", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_dnattr": "uid", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_searchfilter": "", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_uri": "", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_http_headers": "", 2024-09-14T07:11:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_object_name_utc": "false", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attr_name_len": "0", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attr_size": "0", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_chunk_size": "4194304", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_listing_results": "1000", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_notify_retries": "10", 2024-09-14T07:11:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_put_param_size": "1048576", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_put_size": "5368709120", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_slo_entries": "1000", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_md_log_max_shards": "64", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-14T07:11:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_mp_lock_max_time": "600", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-14T07:11:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_max_gc": "300", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_async_rados_threads": "32", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_control_oids": "8", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_numa_node": "-1", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-14T07:11:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_chunk_size": "100", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_gc_interval": "600", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_thread_timeout": "600", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_tracing": "false", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_token": "", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_url": "", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_verify_ssl": "true", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_rados": "false", 2024-09-14T07:11:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_socket_path": "", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_push_interval": "2.000000", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_lanes": "3", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_partitions": "3", 2024-09-14T07:11:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_print_continue": "true", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_tracing": "false", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm": "", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm_id": "", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_region": "", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-14T07:11:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_request_uri": "", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_batch_size": "64", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_max_aio": "128", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_num_logs": "16", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_thread_interval": "600", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-14T07:11:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_resolve_cname": "false", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_run_sync_thread": "true", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_scheduler_type": "throttler", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_script_uri": "", 2024-09-14T07:11:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_service_provider_name": "", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_client_id": "", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_client_secret": "", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_entry": "sts", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_key": "sts", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_min_session_duration": "900", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_token_introspection_url": "", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_account_in_url": "false", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_auth_entry": "auth", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_auth_url": "", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_custom_header": "", 2024-09-14T07:11:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_need_stats": "true", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_tenant_name": "", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_token_expiration": "86400", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_url": "", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_url_prefix": "swift", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_lease_period": "120", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-14T07:11:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_thread_pool_size": "512", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_comment": "", 2024-09-14T07:11:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_createby": "", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_encoding": "", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_flag": "false", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_origin": "", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_tracker": "", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_trust_forwarded_https": "false", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_max_shards": "32", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_max_user_shards": "1", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_use_opa_authz": "false", 2024-09-14T07:11:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_counters_cache": "false", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_max_buckets": "1000", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_policies_max_num": "100", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_unique_email": "true", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_verify_ssl": "true", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-14T07:11:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone": "", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone_id": "", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup": "", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup_id": "", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgwlc_auto_session_clear": "true", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_block_size": "4096", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-14T07:11:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_size": "536870912", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_index_type": "binary_search", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-14T07:11:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_partition_filters": "false", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_perf": "false", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "run_dir": "/var/run/ceph", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_block_create": "true", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_cache_lru_size": "67108864", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_default_max_object_size": "16777216", 2024-09-14T07:11:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_device_size": "53687091200", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_full_integrity_check": "false", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_batch_capacity": "16", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_main_device_type": "SSD", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-14T07:11:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_segment_size": "67108864", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "set_keepcaps": "false", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "setgroup": "", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "setuser": "", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "setuser_match_path": "", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "thp": "false", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "threadpool_default_timeout": "60", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-14T07:11:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "throttler_perf_counter": "true", 2024-09-14T07:11:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "tmp_dir": "/tmp", 2024-09-14T07:11:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-14T07:11:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "uadk_compressor_enabled": "false", 2024-09-14T07:11:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-14T07:11:50.391 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:50.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-14T07:11:50.505 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a: {} 2024-09-14T07:11:50.505 INFO:teuthology.orchestra.run.smithi071.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T07:11:50.514 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b: {} 2024-09-14T07:11:50.515 INFO:teuthology.orchestra.run.smithi071.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T07:11:50.523 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c: {} 2024-09-14T07:11:50.523 INFO:teuthology.orchestra.run.smithi071.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T07:11:50.534 DEBUG:teuthology.orchestra.run.smithi086:> type ceph-objectstore-tool 2024-09-14T07:11:50.551 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T07:11:50.552 DEBUG:teuthology.orchestra.run.smithi071:> type ceph-objectstore-tool 2024-09-14T07:11:50.567 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T07:11:50.567 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-14T07:11:50.578 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-14T07:11:50.578 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-14T07:11:50.578 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T07:11:50.578 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:11:50.579 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-14T07:11:50.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-14T07:11:50.579 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-14T07:11:50.580 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-14T07:11:50.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:11:50.580 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-14T07:11:50.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:11:50.581 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-14T07:11:50.581 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:11:50.581 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-14T07:11:50.608 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:50.606+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:50.648 INFO:teuthology.orchestra.run.smithi071.stdout:mapped writes DISABLED 2024-09-14T07:11:50.648 INFO:teuthology.orchestra.run.smithi071.stdout:mapped reads DISABLED 2024-09-14T07:11:50.648 INFO:teuthology.orchestra.run.smithi071.stdout:Seed set to 4508 2024-09-14T07:11:50.682 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:50.681+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:50.725 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:50.725 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:50.725 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:50.725 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:50.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:11:50.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:11:50.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:11:50.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:11:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:11:50.782 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:50.780+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:50.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:11:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:11:50.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:11:50.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:11:50.826 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:11:50.826 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:11:50.843 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:11:50.843 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:11:50.844 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:50.844 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:50.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:11:50.860 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:11:50.860 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:11:50.878 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:11:50.878 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:11:50.883 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:50.881+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:50.917 INFO:teuthology.orchestra.run.smithi071.stdout:moved 0 / 18 (0%) 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:avg 2.25 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:stddev 1.29904 -> 1.29904 (expected baseline 1.40312) 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:min osd.4 with 0 -> 0 pgs (0 -> 0 * mean) 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:max osd.1 with 4 -> 4 pgs (1.77778 -> 1.77778 * mean) 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:oload 110 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:max_change 1 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:max_change_osds 4 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:average_utilization 0.0003 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stdout:overload_utilization 0.0003 2024-09-14T07:11:50.918 INFO:teuthology.orchestra.run.smithi071.stderr:no change 2024-09-14T07:11:50.931 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-14T07:11:50.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-14T07:11:50.966 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:50.966 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:50.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:11:50.983 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:50.982+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:51.084 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:51.083+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:51.122 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.122 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:11:51.185 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:51.184+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:51.234 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:11:51.238 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.239 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:moved 0 / 82 (0%) 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:avg 10.25 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:oload 1000 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:max_change 3 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:max_change_osds 4 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:average_utilization 0.0003 2024-09-14T07:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout:overload_utilization 0.0029 2024-09-14T07:11:51.270 INFO:teuthology.orchestra.run.smithi071.stderr:no change 2024-09-14T07:11:51.282 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T07:11:51.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-14T07:11:51.286 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:51.286+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:51.372 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.373 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.382 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:11:51.388 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:51.387+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:51.488 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.488 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.489 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:51.487+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:51.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:11:51.589 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:51.588+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:51.617 INFO:teuthology.orchestra.run.smithi071.stdout:moved 0 / 82 (0%) 2024-09-14T07:11:51.617 INFO:teuthology.orchestra.run.smithi071.stdout:avg 10.25 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:oload 110 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:max_change 0.05 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:max_change_osds 4 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:average_utilization 0.0003 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stdout:overload_utilization 0.0003 2024-09-14T07:11:51.618 INFO:teuthology.orchestra.run.smithi071.stderr:no change 2024-09-14T07:11:51.631 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T07:11:51.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-14T07:11:51.653 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.653 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:11:51.690 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:51.689+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:51.792 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:51.791+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:51.809 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.809 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:11:51.892 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:51.891+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:51.922 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:51.922 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:51.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:11:51.935 INFO:teuthology.orchestra.run.smithi071.stdout:moved 0 / 82 (0%) 2024-09-14T07:11:51.935 INFO:teuthology.orchestra.run.smithi071.stdout:avg 10.25 2024-09-14T07:11:51.935 INFO:teuthology.orchestra.run.smithi071.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-14T07:11:51.935 INFO:teuthology.orchestra.run.smithi071.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-14T07:11:51.935 INFO:teuthology.orchestra.run.smithi071.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stdout:oload 110 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stdout:max_change 1 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stdout:max_change_osds 4 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stdout:average_utilization 0.0003 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stdout:overload_utilization 0.0003 2024-09-14T07:11:51.936 INFO:teuthology.orchestra.run.smithi071.stderr:no change 2024-09-14T07:11:51.949 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-14T07:11:51.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-14T07:11:51.993 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:51.992+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:11:52.094 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:52.092+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:52.154 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.154 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:11:52.208 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:52.207+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:52.280 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.280 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.287 INFO:teuthology.orchestra.run.smithi071.stdout:moved 0 / 82 (0%) 2024-09-14T07:11:52.287 INFO:teuthology.orchestra.run.smithi071.stdout:avg 10.25 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:stddev 3.26917 -> 3.26917 (expected baseline 2.99479) 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:min osd.2 with 5 -> 5 pgs (0.487805 -> 0.487805 * mean) 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:oload 110 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:max_change 1 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:max_change_osds 4 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:average_utilization 0.0003 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stdout:overload_utilization 0.0003 2024-09-14T07:11:52.288 INFO:teuthology.orchestra.run.smithi071.stderr:no change 2024-09-14T07:11:52.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:11:52.331 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:52.330+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:52.397 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:52.396+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:52.433 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.433 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.441 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:11:52.498 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:52.496+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:52.542 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.542 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:11:52.599 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:52.598+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:52.655 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.655 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:11:52.700 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:52.699+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:11:52.818 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:52.817+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:52.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:11:52.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:11:52.927 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:52.926+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:53.003 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:53.002+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:53.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:11:53.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:11:53.031 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:53.031 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:53.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:11:53.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:11:53.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:11:53.047 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:11:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:11:53.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:11:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:11:53.079 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:11:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:11:53.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:11:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:11:53.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:11:53.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:11:53.122 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:53.122+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:53.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:11:53.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:11:53.184 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:53.185 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:53.185 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:11:53.185 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:11:53.185 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:53.192 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:11:53.234 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:53.233+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:53.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:11:53.306 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:53.305+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:53.334 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:53.334 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:11:53.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:11:53.335 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [] 2024-09-14T07:11:53.335 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:53.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:11:53.406 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:53.406+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:53.445 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:53.445 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:53.445 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:11:53.445 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:53.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:11:53.508 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:53.507+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:53.555 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:53.555 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:53.555 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:11:53.555 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:11:53.555 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:53.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:11:53.609 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:53.608+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:11:53.673 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.536618914, 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:11:53.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:11:53.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:11:53.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.922761+0000", 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.74876738, 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070065989999999996, 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 46 2024-09-14T07:11:53.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922761+0000", 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922761+0000", 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922761+0000", 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9999999999999998e-07 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922774+0000", 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922783+0000", 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1109999999999997e-06 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922789+0000", 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2230000000000004e-06 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.926098+0000", 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033087440000000002 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.926147+0000", 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9428999999999997e-05 2024-09-14T07:11:53.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.926232+0000", 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4963000000000006e-05 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.928194+0000", 2024-09-14T07:11:53.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001961656 2024-09-14T07:11:53.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929695+0000", 2024-09-14T07:11:53.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015004759999999999 2024-09-14T07:11:53.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929731+0000", 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5967999999999999e-05 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929767+0000", 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6602e-05 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.922821+0000", 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.748706959, 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071102470000000001, 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 47 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922821+0000", 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922821+0000", 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922822+0000", 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2900000000000003e-07 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922903+0000", 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1460999999999998e-05 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922913+0000", 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0227000000000001e-05 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922921+0000", 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7589999999999997e-06 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.926605+0000", 2024-09-14T07:11:53.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003683618 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.926657+0000", 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2098000000000002e-05 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.926742+0000", 2024-09-14T07:11:53.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5075999999999997e-05 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929326+0000", 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025843580000000001 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929866+0000", 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00053955500000000005 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929908+0000", 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2330999999999998e-05 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929931+0000", 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3034999999999999e-05 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.922936+0000", 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.748591972, 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007073078, 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922936+0000", 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922936+0000", 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922937+0000", 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6300000000000005e-07 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922941+0000", 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6070000000000001e-06 2024-09-14T07:11:53.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922948+0000", 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7610000000000002e-06 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922954+0000", 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.927139+0000", 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041846929999999997 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.927190+0000", 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1582999999999997e-05 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.927271+0000", 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1273000000000006e-05 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929811+0000", 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025400090000000002 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929940+0000", 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000128429 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929988+0000", 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-05 2024-09-14T07:11:53.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930009+0000", 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0701999999999999e-05 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.922964+0000", 2024-09-14T07:11:53.701 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.748563561999999, 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071050449999999999, 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 49 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922964+0000", 2024-09-14T07:11:53.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922964+0000", 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922965+0000", 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8100000000000003e-07 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922969+0000", 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9079999999999997e-06 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922975+0000", 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4119999999999998e-06 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922981+0000", 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.288e-06 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.927792+0000", 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048115500000000004 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.927844+0000", 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1428000000000003e-05 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.927933+0000", 2024-09-14T07:11:53.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9739000000000003e-05 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929857+0000", 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019237340000000001 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930016+0000", 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159424 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930047+0000", 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0144000000000001e-05 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930069+0000", 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2836999999999998e-05 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.922990+0000", 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.748538286, 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071738130000000002, 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 50 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.708 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922990+0000", 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922990+0000", 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.922990+0000", 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5400000000000001e-07 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923059+0000", 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9123999999999998e-05 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923071+0000", 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2130000000000001e-05 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923078+0000", 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6100000000000002e-06 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.928230+0000", 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051520860000000002 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.928282+0000", 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1888999999999997e-05 2024-09-14T07:11:53.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.928365+0000", 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3449999999999996e-05 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930075+0000", 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017092349999999999 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930105+0000", 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0580999999999997e-05 2024-09-14T07:11:53.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930139+0000", 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3467000000000003e-05 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930163+0000", 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4686999999999999e-05 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.923091+0000", 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.748436892000001, 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072470369999999996, 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 51 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.714 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923091+0000", 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923091+0000", 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923092+0000", 2024-09-14T07:11:53.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6899999999999996e-07 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923097+0000", 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8400000000000002e-06 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923104+0000", 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8900000000000001e-06 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923109+0000", 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3129999999999998e-06 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.928817+0000", 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057077610000000004 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.928887+0000", 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0282000000000002e-05 2024-09-14T07:11:53.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929006+0000", 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011934000000000001 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930079+0000", 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001073049 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930288+0000", 2024-09-14T07:11:53.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000208815 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930318+0000", 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9402000000000001e-05 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930338+0000", 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0475999999999998e-05 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.923118+0000", 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.748410259, 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080373389999999992, 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 52 2024-09-14T07:11:53.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923118+0000", 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923118+0000", 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923118+0000", 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9500000000000002e-07 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923123+0000", 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3780000000000003e-06 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923130+0000", 2024-09-14T07:11:53.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4630000000000004e-06 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.923136+0000", 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9900000000000002e-06 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929351+0000", 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0062143290000000002 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929430+0000", 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9350000000000004e-05 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.929519+0000", 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9116000000000005e-05 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.930176+0000", 2024-09-14T07:11:53.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065733600000000001 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.931107+0000", 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00093048499999999999 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.931134+0000", 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7478999999999999e-05 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.931155+0000", 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0718000000000001e-05 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:65 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.144602+0000", 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526926349, 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070455980000000001, 2024-09-14T07:11:53.726 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 65 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144602+0000", 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144602+0000", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144602+0000", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3599999999999999e-07 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144604+0000", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3199999999999998e-06 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144609+0000", 2024-09-14T07:11:53.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144612+0000", 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2569999999999999e-06 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145253+0000", 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00064160699999999998 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145320+0000", 2024-09-14T07:11:53.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6357000000000002e-05 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145402+0000", 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2513000000000001e-05 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147544+0000", 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021414910000000001 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151592+0000", 2024-09-14T07:11:53.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040479340000000004 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151622+0000", 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0309999999999999e-05 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151647+0000", 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5134e-05 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.144651+0000", 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526877368999999, 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070803359999999996, 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 66 2024-09-14T07:11:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144651+0000", 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144651+0000", 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144651+0000", 2024-09-14T07:11:53.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6700000000000003e-07 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144723+0000", 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1738999999999999e-05 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144731+0000", 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9200000000000004e-06 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144735+0000", 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8e-06 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145737+0000", 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010022919999999999 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145817+0000", 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0136999999999995e-05 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145956+0000", 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013924400000000001 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147548+0000", 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015912070000000001 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151684+0000", 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041368769999999997 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151711+0000", 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6509e-05 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151731+0000", 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9944000000000001e-05 2024-09-14T07:11:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.144743+0000", 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526785402, 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071199970000000003, 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 67 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144743+0000", 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144743+0000", 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144743+0000", 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144745+0000", 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:11:53.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144749+0000", 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7799999999999998e-06 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144753+0000", 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7529999999999999e-06 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.146591+0000", 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018383049999999999 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.146645+0000", 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4302000000000003e-05 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.146723+0000", 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7712000000000004e-05 2024-09-14T07:11:53.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151660+0000", 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049373430000000003 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151773+0000", 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112724 2024-09-14T07:11:53.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151816+0000", 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3065999999999997e-05 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151863+0000", 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6443000000000002e-05 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.144834+0000", 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526693895999999, 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071099070000000004, 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 68 2024-09-14T07:11:53.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144834+0000", 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144834+0000", 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144835+0000", 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144838+0000", 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1520000000000001e-06 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144844+0000", 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4010000000000002e-06 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144847+0000", 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0989999999999999e-06 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147152+0000", 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002304408 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147199+0000", 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6952e-05 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147274+0000", 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5879999999999999e-05 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151665+0000", 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043902990000000003 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151903+0000", 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023797299999999999 2024-09-14T07:11:53.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151927+0000", 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4542e-05 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151944+0000", 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6711e-05 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.144886+0000", 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526642128000001, 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071403639999999997, 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 69 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144886+0000", 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144886+0000", 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144886+0000", 2024-09-14T07:11:53.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7100000000000002e-07 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144977+0000", 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0469000000000004e-05 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144985+0000", 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5369999999999997e-06 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144990+0000", 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2830000000000003e-06 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147588+0000", 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025980629999999998 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147678+0000", 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0549000000000003e-05 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.147782+0000", 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104147 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151876+0000", 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040940880000000001 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.151976+0000", 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9396999999999997e-05 2024-09-14T07:11:53.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152004+0000", 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7688999999999999e-05 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152026+0000", 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2671e-05 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.144998+0000", 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526530136, 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091639119999999998, 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 70 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144998+0000", 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144998+0000", 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.144998+0000", 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8000000000000001e-07 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145001+0000", 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8669999999999998e-06 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145006+0000", 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.339e-06 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145009+0000", 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.083e-06 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.148273+0000", 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032638279999999999 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.148324+0000", 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0283e-05 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.148399+0000", 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5446999999999998e-05 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152062+0000", 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036628229999999999 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154103+0000", 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002041265 2024-09-14T07:11:53.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154136+0000", 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2928000000000001e-05 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154162+0000", 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5669000000000001e-05 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.145014+0000", 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526514348999999, 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0091994030000000001, 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 71 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.763 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145014+0000", 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145014+0000", 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145014+0000", 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6899999999999999e-07 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145018+0000", 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9029999999999997e-06 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145025+0000", 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145029+0000", 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6330000000000002e-06 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.148693+0000", 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036637140000000002 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.148743+0000", 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9926999999999998e-05 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.148823+0000", 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0098999999999993e-05 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152944+0000", 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004121675 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154168+0000", 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001223935 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154192+0000", 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4006999999999999e-05 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154213+0000", 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0713e-05 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.145041+0000", 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526487109, 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0094439369999999995, 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 72 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145041+0000", 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145041+0000", 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145041+0000", 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.27e-07 2024-09-14T07:11:53.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145088+0000", 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7101999999999997e-05 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145095+0000", 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5780000000000004e-06 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145098+0000", 2024-09-14T07:11:53.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4039999999999999e-06 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.149096+0000", 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039977140000000003 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.149145+0000", 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8934000000000003e-05 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.149228+0000", 2024-09-14T07:11:53.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2836000000000004e-05 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152984+0000", 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003756695 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154441+0000", 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001456604 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154466+0000", 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4736000000000002e-05 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154485+0000", 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9006999999999999e-05 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.145105+0000", 2024-09-14T07:11:53.774 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526422981, 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010111586000000001, 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 73 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145105+0000", 2024-09-14T07:11:53.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145105+0000", 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145105+0000", 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5699999999999998e-07 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145108+0000", 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5629999999999999e-06 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145118+0000", 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0033e-05 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145121+0000", 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9859999999999999e-06 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152092+0000", 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069712100000000003 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152145+0000", 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2744999999999997e-05 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152268+0000", 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012287999999999999 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154489+0000", 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022208839999999998 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155158+0000", 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066978399999999998 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155192+0000", 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.392e-05 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155217+0000", 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4224e-05 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.145126+0000", 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526402198, 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010399004, 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 74 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145126+0000", 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145126+0000", 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145126+0000", 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5400000000000002e-07 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145128+0000", 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3810000000000002e-06 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145134+0000", 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3809999999999998e-06 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145139+0000", 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7709999999999997e-06 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152545+0000", 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074062590000000001 2024-09-14T07:11:53.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152592+0000", 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7024999999999998e-05 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.152667+0000", 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5665000000000001e-05 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154491+0000", 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001823599 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155460+0000", 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00096870400000000003 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155502+0000", 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2518999999999997e-05 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155525+0000", 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2446000000000002e-05 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.145143+0000", 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526385373, 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010460226, 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 75 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.787 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145143+0000", 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145143+0000", 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145143+0000", 2024-09-14T07:11:53.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.29e-07 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145181+0000", 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7882000000000001e-05 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145188+0000", 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2799999999999998e-06 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145191+0000", 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.258e-06 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.153014+0000", 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0078225139999999992 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.153063+0000", 2024-09-14T07:11:53.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8956999999999999e-05 2024-09-14T07:11:53.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.153143+0000", 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0556000000000006e-05 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154493+0000", 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013502010000000001 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155558+0000", 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0010648630000000001 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155584+0000", 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6077000000000001e-05 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155603+0000", 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8408999999999999e-05 2024-09-14T07:11:53.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:39.145197+0000", 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.526331009, 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010471764999999999, 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:11:53.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 76 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145197+0000", 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145197+0000", 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145197+0000", 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1899999999999998e-07 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145200+0000", 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4159999999999998e-06 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145203+0000", 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3519999999999998e-06 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.145206+0000", 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5610000000000001e-06 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.153543+0000", 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083370409999999999 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.153589+0000", 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:11:53.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.153689+0000", 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9240000000000005e-05 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.154496+0000", 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00080721500000000002 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155626+0000", 2024-09-14T07:11:53.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001130477 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155651+0000", 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4369e-05 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:39.155669+0000", 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8110000000000001e-05 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:53.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:53.801 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:53.802 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:53.801+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:53.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:11:53.903 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:53.902+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:53.908 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:53.908 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:53.908 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:53.908 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:53.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:11:54.004 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:54.004+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:54.061 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:11:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:11:54.061 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:11:54.106 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:54.105+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:54 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'36, mlcod=17'33)", 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:38.932246+0000", 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.241472441000001, 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029172500000000001, 2024-09-14T07:11:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932246+0000", 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932246+0000", 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932246+0000", 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8800000000000002e-07 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932293+0000", 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6742000000000001e-05 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932311+0000", 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7289e-05 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932316+0000", 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2089999999999996e-06 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932352+0000", 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6755000000000003e-05 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932365+0000", 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2482e-05 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.935139+0000", 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027737159999999999 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.935163+0000", 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4369e-05 2024-09-14T07:11:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:55 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'37, mlcod=17'33)", 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:38.932830+0000", 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.240888072000001, 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051984780000000003, 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932830+0000", 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932830+0000", 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932831+0000", 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2e-07 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932898+0000", 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6931e-05 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932906+0000", 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0269999999999995e-06 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932910+0000", 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9670000000000003e-06 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932948+0000", 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8336e-05 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.932959+0000", 2024-09-14T07:11:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1338000000000001e-05 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.937983+0000", 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005024059 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.938029+0000", 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5300000000000003e-05 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:56 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'38, mlcod=17'33)", 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:38.933418+0000", 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.240299863000001, 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046433539999999997, 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933418+0000", 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933418+0000", 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933419+0000", 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4199999999999996e-07 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933487+0000", 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8040000000000006e-05 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933495+0000", 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0809999999999994e-06 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933499+0000", 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6449999999999998e-06 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933538+0000", 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9662000000000001e-05 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.933553+0000", 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.486e-05 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.938032+0000", 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044791040000000002 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:38.938062+0000", 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-05 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.145500+0000", 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.028218567, 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003344039, 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145500+0000", 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145500+0000", 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145500+0000", 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5000000000000002e-07 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145506+0000", 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.485e-06 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145518+0000", 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1824999999999999e-05 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145524+0000", 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1940000000000003e-06 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145580+0000", 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6397999999999998e-05 2024-09-14T07:11:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.145598+0000", 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.738e-05 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148807+0000", 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003209188 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148844+0000", 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6819000000000001e-05 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.146063+0000", 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.027655007, 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031375079999999998, 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146063+0000", 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146063+0000", 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146064+0000", 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3799999999999997e-07 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146121+0000", 2024-09-14T07:11:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7294999999999999e-05 2024-09-14T07:11:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146130+0000", 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3710000000000006e-06 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146135+0000", 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5530000000000003e-06 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146175+0000", 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0445999999999999e-05 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146194+0000", 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8192000000000001e-05 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149174+0000", 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029804829999999999 2024-09-14T07:11:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149201+0000", 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.146809+0000", 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.026909143999999, 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024108749999999998, 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146809+0000", 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146809+0000", 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146810+0000", 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.51e-07 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146816+0000", 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7100000000000001e-06 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146823+0000", 2024-09-14T07:11:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5690000000000001e-06 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146826+0000", 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3639999999999999e-06 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146860+0000", 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3566999999999999e-05 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.146873+0000", 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2974e-05 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149203+0000", 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002330206 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149220+0000", 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7034e-05 2024-09-14T07:11:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'41)", 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.148488+0000", 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.025229985999999, 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003290065, 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148488+0000", 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148488+0000", 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148489+0000", 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0399999999999996e-07 2024-09-14T07:11:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148496+0000", 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1720000000000001e-06 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148506+0000", 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0203e-05 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148515+0000", 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.986e-06 2024-09-14T07:11:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148554+0000", 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8407e-05 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148566+0000", 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1916000000000001e-05 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.151750+0000", 2024-09-14T07:11:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031847949999999998 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.151778+0000", 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7982000000000001e-05 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'41)", 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.148909+0000", 2024-09-14T07:11:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.024809513999999, 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032117270000000002, 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148909+0000", 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148909+0000", 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148909+0000", 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6599999999999996e-07 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148913+0000", 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0419999999999996e-06 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148922+0000", 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7260000000000008e-06 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148926+0000", 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3120000000000004e-06 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148983+0000", 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6830999999999998e-05 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.148996+0000", 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2773e-05 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152097+0000", 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031013479999999999 2024-09-14T07:11:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152120+0000", 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3129000000000002e-05 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'41)", 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.149398+0000", 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.024320191999999, 2024-09-14T07:11:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027408419999999998, 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149398+0000", 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149398+0000", 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149399+0000", 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3799999999999997e-07 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149466+0000", 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7368999999999998e-05 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149473+0000", 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6170000000000003e-06 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149476+0000", 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5760000000000002e-06 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149511+0000", 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5339000000000002e-05 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.149523+0000", 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1959e-05 2024-09-14T07:11:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152123+0000", 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025991830000000001 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152139+0000", 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6260999999999999e-05 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'46)", 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.152345+0000", 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.021373425, 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027189499999999999, 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152345+0000", 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152345+0000", 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152345+0000", 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4299999999999998e-07 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152348+0000", 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1920000000000001e-06 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152358+0000", 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4669999999999993e-06 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152363+0000", 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.69e-06 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152398+0000", 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4907999999999998e-05 2024-09-14T07:11:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152409+0000", 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1218e-05 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.155038+0000", 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026290139999999998 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.155064+0000", 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6018000000000001e-05 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'46)", 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.152751+0000", 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.020967655, 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026190850000000002, 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152751+0000", 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152751+0000", 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152751+0000", 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152754+0000", 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1920000000000001e-06 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152760+0000", 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7969999999999997e-06 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152763+0000", 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7e-06 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152795+0000", 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2487999999999998e-05 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.152806+0000", 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-09-14T07:11:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.155346+0000", 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025402490000000001 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.155370+0000", 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3561999999999999e-05 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'46)", 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.153247+0000", 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.020471366000001, 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021381439999999998, 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153247+0000", 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153247+0000", 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153247+0000", 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153310+0000", 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2978999999999995e-05 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153317+0000", 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3940000000000001e-06 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153320+0000", 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0750000000000002e-06 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153352+0000", 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2261000000000002e-05 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.153362+0000", 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0509000000000001e-05 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.155371+0000", 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020085099999999998 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.155385+0000", 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4019000000000001e-05 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:78 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'56, mlcod=17'53)", 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.156681+0000", 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.017037462999999, 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031004520000000001, 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156681+0000", 2024-09-14T07:11:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156681+0000", 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156681+0000", 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4000000000000001e-07 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156724+0000", 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2511e-05 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156734+0000", 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6409999999999997e-06 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156738+0000", 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6079999999999998e-06 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156777+0000", 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8569999999999998e-05 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.156789+0000", 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2310000000000001e-05 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.159752+0000", 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002962962 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.159781+0000", 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.921e-05 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:79 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'57, mlcod=17'53)", 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.157201+0000", 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.016517489, 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027640130000000001, 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157201+0000", 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157201+0000", 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157201+0000", 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157267+0000", 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5907000000000004e-05 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157274+0000", 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1330000000000001e-06 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157278+0000", 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8789999999999996e-06 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157311+0000", 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3327000000000001e-05 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157323+0000", 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-09-14T07:11:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.159934+0000", 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026112800000000001 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.159965+0000", 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0267999999999999e-05 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:80 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'58, mlcod=17'53)", 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.157700+0000", 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.016017967, 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025221879999999999, 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157700+0000", 2024-09-14T07:11:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157700+0000", 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157701+0000", 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9500000000000002e-07 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157767+0000", 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6577999999999999e-05 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157775+0000", 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9030000000000004e-06 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157779+0000", 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157812+0000", 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2382000000000003e-05 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.157824+0000", 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.273e-05 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160202+0000", 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002377531 2024-09-14T07:11:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160222+0000", 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0432e-05 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:81 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'59, mlcod=17'57)", 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.160885+0000", 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.012833392999999, 2024-09-14T07:11:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021193369999999998, 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160885+0000", 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160885+0000", 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160885+0000", 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3900000000000005e-07 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160889+0000", 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5030000000000002e-06 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160900+0000", 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160907+0000", 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.764e-06 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160946+0000", 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8936999999999997e-05 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.160958+0000", 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1773000000000001e-05 2024-09-14T07:11:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.162975+0000", 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002016978 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.163004+0000", 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9366999999999999e-05 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:92 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'66, mlcod=17'62)", 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.430764+0000", 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.742953806999999, 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020998050000000002, 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430764+0000", 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430764+0000", 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430765+0000", 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8299999999999997e-07 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430769+0000", 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430776+0000", 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6350000000000006e-06 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430780+0000", 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6689999999999999e-06 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430818+0000", 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7951000000000003e-05 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.430829+0000", 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1253000000000001e-05 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.432834+0000", 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020044680000000001 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.432864+0000", 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0694999999999997e-05 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4209.0:96 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'70, mlcod=17'67)", 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:39.434378+0000", 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.739339963999999, 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002753307, 2024-09-14T07:11:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434378+0000", 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434378+0000", 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434379+0000", 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4700000000000002e-07 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434465+0000", 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6440999999999995e-05 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434472+0000", 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7290000000000003e-06 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434475+0000", 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0249999999999998e-06 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434506+0000", 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0922e-05 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.434517+0000", 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1744e-05 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.437107+0000", 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895639999999999 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:39.437132+0000", 2024-09-14T07:11:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4535000000000001e-05 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:53.650426+0000", 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.52329227499999997, 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041103829999999996, 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 11 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650426+0000", 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650426+0000", 2024-09-14T07:11:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650427+0000", 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5099999999999999e-06 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650441+0000", 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3728e-05 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650456+0000", 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5002e-05 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650464+0000", 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7570000000000004e-06 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650521+0000", 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7101000000000001e-05 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.650528+0000", 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4999999999999996e-06 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.652780+0000", 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022526450000000002 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.652903+0000", 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012265600000000001 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.653118+0000", 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000215484 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.653990+0000", 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000871742 2024-09-14T07:11:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654469+0000", 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047923200000000001 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654514+0000", 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4879000000000002e-05 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654536+0000", 2024-09-14T07:11:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2147e-05 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:12 3.1f 3:f914f0d9:::rbd_header.1182f1e71464:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:53.654638+0000", 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.51908049599999995, 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039776500000000001, 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 12 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654638+0000", 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654638+0000", 2024-09-14T07:11:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654639+0000", 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999993e-07 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654644+0000", 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654655+0000", 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1090000000000001e-05 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654662+0000", 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.878e-06 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654698+0000", 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6115000000000002e-05 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654778+0000", 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9963999999999995e-05 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.654906+0000", 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012785800000000001 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.655323+0000", 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041706799999999999 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.658564+0000", 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032409159999999999 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.658592+0000", 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8225000000000002e-05 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.658615+0000", 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3524999999999999e-05 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.275 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.275 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.275 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:11:54.277 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:54.275+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:54.377 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:54.376+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:54.422 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.422 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:54.422 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:54.422 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:11:54.477 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:54.476+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:54.535 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.535 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:54.535 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:11:54.535 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:11:54.535 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:11:54.585 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:54.584+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:54.680 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:54.679+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4238.0:5 2.2 e21/19 2:5cea7035:::rbd_info:head v 21'1, mlcod=0'0)", 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:43.169090+0000", 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.51971573, 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099791000000000007, 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169090+0000", 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169090+0000", 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169091+0000", 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9000000000000001e-07 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169097+0000", 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0870000000000003e-06 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169109+0000", 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2695e-05 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169120+0000", 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0761000000000001e-05 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169176+0000", 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5834000000000001e-05 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169202+0000", 2024-09-14T07:11:54.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6361000000000001e-05 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.170047+0000", 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084427600000000003 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.170088+0000", 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1705999999999997e-05 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4238.0:7 2.2 e22/19 2:5cea7035:::rbd_info:head v 22'2, mlcod=0'0)", 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.515678432, 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084279600000000004, 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.92e-07 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173135+0000", 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0570000000000004e-06 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173146+0000", 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0635000000000001e-05 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173157+0000", 2024-09-14T07:11:54.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0968000000000001e-05 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173218+0000", 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1338000000000001e-05 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173236+0000", 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179e-05 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173922+0000", 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068598900000000002 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173970+0000", 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8437999999999999e-05 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:54.698 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.04529106, 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00089881800000000001, 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:54.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:54.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:54.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6399999999999998e-07 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643521+0000", 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7320000000000003e-06 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643532+0000", 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1267000000000001e-05 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:54.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643542+0000", 2024-09-14T07:11:54.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0010000000000001e-05 2024-09-14T07:11:54.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:54.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643591+0000", 2024-09-14T07:11:54.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8309000000000001e-05 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643606+0000", 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5252000000000001e-05 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:54.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.644374+0000", 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076763099999999996 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.644414+0000", 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0352999999999998e-05 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:54.705 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:11:54.780 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:54.779+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:54.811 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:54.811 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:11:54.904 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:54.903+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:54.964 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:54.964 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:54.964 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:11:54.965 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:11:54.965 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:54.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:11:55.017 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:55.014+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:55.083 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:55.083+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4238.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.956100853000001, 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090097599999999995, 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:55.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9500000000000001e-07 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163548+0000", 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8449999999999996e-06 2024-09-14T07:11:55.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163557+0000", 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2499999999999995e-06 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163565+0000", 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.106e-06 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:55.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163603+0000", 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7758e-05 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163624+0000", 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0721e-05 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.164409+0000", 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078467499999999998 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:55.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.164445+0000", 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6426e-05 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:55.126 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:55.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:11:55.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:11:55.184 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:55.183+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:55.276 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:55.276 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:55.276 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:55.276 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:55.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:11:55.286 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:55.284+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:55.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:11:55.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:11:55.310 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:11:55.310 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:11:55.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:11:55.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:11:55.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:11:55.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:11:55.374 INFO:teuthology.orchestra.run.smithi071.stdout:skipping zero size read 2024-09-14T07:11:55.374 INFO:teuthology.orchestra.run.smithi071.stdout:skipping zero size read 2024-09-14T07:11:55.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:11:55.382 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:11:55.385 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:55.385+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:55.386 INFO:teuthology.orchestra.run.smithi071.stdout:6 write 0x5424cb8 thru 0x5428080 (0x33c9 bytes) 2024-09-14T07:11:55.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:11:55.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:11:55.404 INFO:teuthology.orchestra.run.smithi071.stdout:7 write 0xc0dd204 thru 0xc0de04f (0xe4c bytes) 2024-09-14T07:11:55.407 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.407 INFO:teuthology.orchestra.run.smithi071.stdout:13 read 0x421d926 thru 0x4224e06 (0x74e1 bytes) 2024-09-14T07:11:55.416 INFO:teuthology.orchestra.run.smithi071.stdout:14 write 0xdec2790 thru 0xdecad1b (0x858c bytes) 2024-09-14T07:11:55.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:11:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:11:55.420 INFO:teuthology.orchestra.run.smithi071.stdout:15 writesame 0xc8f8670 thru 0xc90209d data_size 0x5(0x9a2e bytes) 2024-09-14T07:11:55.424 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:55.424 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:55.426 INFO:teuthology.orchestra.run.smithi071.stdout:16 writesame 0xbe0be02 thru 0xbe0cd5e data_size 0x17(0xf5d bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:19 read 0x91cb0 thru 0x9cf7a (0xb2cb bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:21 punch from 0x736395 to 0x741048, (0xacb3 bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:22 punch from 0x1ca4a5d to 0x1cb3812, (0xedb5 bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:23 read 0xaef3968 thru 0xaf01624 (0xdcbd bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:25 read 0x69698a3 thru 0x6971588 (0x7ce6 bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:26 read 0x2ec9f7f thru 0x2ed5e1a (0xbe9c bytes) 2024-09-14T07:11:55.430 INFO:teuthology.orchestra.run.smithi071.stdout:truncating to largest ever: 0x7e7bade 2024-09-14T07:11:55.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:11:55.438 INFO:teuthology.orchestra.run.smithi071.stdout:27 trunc from 0xdecad1c to 0x7e7bade 2024-09-14T07:11:55.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:11:55.442 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:11:55.448 INFO:teuthology.orchestra.run.smithi071.stdout:28 read 0x7aba0bf thru 0x7abc3dc (0x231e bytes) 2024-09-14T07:11:55.458 INFO:teuthology.orchestra.run.smithi071.stdout:29 writesame 0xbe1093e thru 0xbe15220 data_size 0x1(0x48e3 bytes) 2024-09-14T07:11:55.458 INFO:teuthology.orchestra.run.smithi071.stdout:30 write 0x2d6779b thru 0x2d6fee5 (0x874b bytes) 2024-09-14T07:11:55.462 INFO:teuthology.orchestra.run.smithi071.stdout:truncating to largest ever: 0xdbe4163 2024-09-14T07:11:55.464 INFO:teuthology.orchestra.run.smithi071.stdout:31 trunc from 0xbe15221 to 0xdbe4163 2024-09-14T07:11:55.469 INFO:teuthology.orchestra.run.smithi071.stdout:32 writesame 0x475da18 thru 0x476d836 data_size 0x5(0xfe1f bytes) 2024-09-14T07:11:55.487 INFO:teuthology.orchestra.run.smithi071.stdout:33 trunc from 0xdbe4163 to 0x7d6fad9 2024-09-14T07:11:55.487 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:55.486+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:55.491 INFO:teuthology.orchestra.run.smithi071.stdout:34 write 0x4849de5 thru 0x4853519 (0x9735 bytes) 2024-09-14T07:11:55.498 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.498 INFO:teuthology.orchestra.run.smithi071.stdout:36 read 0x3c149e2 thru 0x3c15526 (0xb45 bytes) 2024-09-14T07:11:55.510 INFO:teuthology.orchestra.run.smithi071.stdout:38 write 0xe8771da thru 0xe878d35 (0x1b5c bytes) 2024-09-14T07:11:55.513 INFO:teuthology.orchestra.run.smithi071.stdout:40 write 0xa4f97a8 thru 0xa502c72 (0x94cb bytes) 2024-09-14T07:11:55.517 INFO:teuthology.orchestra.run.smithi071.stdout:41 punch from 0x306091f to 0x3060a19, (0xfa bytes) 2024-09-14T07:11:55.524 INFO:teuthology.orchestra.run.smithi071.stdout:43 trunc from 0xe878d36 to 0x8957b7d 2024-09-14T07:11:55.533 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.533 INFO:teuthology.orchestra.run.smithi071.stdout:45 read 0x8464a9c thru 0x846c85a (0x7dbf bytes) 2024-09-14T07:11:55.533 INFO:teuthology.orchestra.run.smithi071.stdout:46 read 0x4e665b8 thru 0x4e72873 (0xc2bc bytes) 2024-09-14T07:11:55.533 INFO:teuthology.orchestra.run.smithi071.stdout:47 punch from 0x4119636 to 0x411cd3f, (0x3709 bytes) 2024-09-14T07:11:55.533 INFO:teuthology.orchestra.run.smithi071.stdout:48 write 0x7bede1e thru 0x7bf0576 (0x2759 bytes) 2024-09-14T07:11:55.536 INFO:teuthology.orchestra.run.smithi071.stdout:49 read 0x97b84b thru 0x9853d5 (0x9b8b bytes) 2024-09-14T07:11:55.537 INFO:teuthology.orchestra.run.smithi071.stdout:51 trunc from 0x8957b7d to 0x9e03b61 2024-09-14T07:11:55.542 INFO:teuthology.orchestra.run.smithi071.stdout:52 write 0x8a7515 thru 0x8b2d33 (0xb81f bytes) 2024-09-14T07:11:55.555 INFO:teuthology.orchestra.run.smithi071.stdout:54 write 0xeb4280a thru 0xeb43ee4 (0x16db bytes) 2024-09-14T07:11:55.556 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:55.556 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:55.558 INFO:teuthology.orchestra.run.smithi071.stdout:55 punch from 0x74580ce to 0x745e7a1, (0x66d3 bytes) 2024-09-14T07:11:55.558 INFO:teuthology.orchestra.run.smithi071.stdout:58 write 0x67db750 thru 0x67e41ee (0x8a9f bytes) 2024-09-14T07:11:55.560 INFO:teuthology.orchestra.run.smithi071.stdout:59 write 0x67ac5f6 thru 0x67b37c8 (0x71d3 bytes) 2024-09-14T07:11:55.562 INFO:teuthology.orchestra.run.smithi071.stdout:60 write 0x6c3962f thru 0x6c43770 (0xa142 bytes) 2024-09-14T07:11:55.565 INFO:teuthology.orchestra.run.smithi071.stdout:61 read 0xa09bd5e thru 0xa0a0952 (0x4bf5 bytes) 2024-09-14T07:11:55.565 INFO:teuthology.orchestra.run.smithi071.stdout:62 writesame 0x3582765 thru 0x358c3b3 data_size 0x35(0x9c4f bytes) 2024-09-14T07:11:55.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:11:55.568 INFO:teuthology.orchestra.run.smithi071.stdout:63 read 0x44d26e4 thru 0x44e0b0e (0xe42b bytes) 2024-09-14T07:11:55.569 INFO:teuthology.orchestra.run.smithi071.stdout:64 writesame 0xd077f70 thru 0xd07a35f data_size 0x50(0x23f0 bytes) 2024-09-14T07:11:55.571 INFO:teuthology.orchestra.run.smithi071.stdout:65 write 0xcd4bbc0 thru 0xcd56246 (0xa687 bytes) 2024-09-14T07:11:55.575 INFO:teuthology.orchestra.run.smithi071.stdout:66 read 0x55e0ecd thru 0x55e3ad9 (0x2c0d bytes) 2024-09-14T07:11:55.575 INFO:teuthology.orchestra.run.smithi071.stdout:68 read 0x8c04ca5 thru 0x8c13421 (0xe77d bytes) 2024-09-14T07:11:55.581 INFO:teuthology.orchestra.run.smithi071.stdout:69 trunc from 0xeb43ee5 to 0xa2a89a5 2024-09-14T07:11:55.588 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:55.587+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:55.593 INFO:teuthology.orchestra.run.smithi071.stdout:70 read 0x206011d thru 0x20696c3 (0x95a7 bytes) 2024-09-14T07:11:55.593 INFO:teuthology.orchestra.run.smithi071.stdout:71 read 0x4660652 thru 0x4670292 (0xfc41 bytes) 2024-09-14T07:11:55.594 INFO:teuthology.orchestra.run.smithi071.stdout:72 trunc from 0xa2a89a5 to 0x9b1d875 2024-09-14T07:11:55.608 INFO:teuthology.orchestra.run.smithi071.stdout:74 write 0xbc17d96 thru 0xbc204aa (0x8715 bytes) 2024-09-14T07:11:55.611 INFO:teuthology.orchestra.run.smithi071.stdout:75 write 0x6084c4 thru 0x60bbbf (0x36fc bytes) 2024-09-14T07:11:55.615 INFO:teuthology.orchestra.run.smithi071.stdout:76 read 0xa946ef8 thru 0xa94c25a (0x5363 bytes) 2024-09-14T07:11:55.615 INFO:teuthology.orchestra.run.smithi071.stdout:77 read 0x9983f70 thru 0x9984e99 (0xf2a bytes) 2024-09-14T07:11:55.615 INFO:teuthology.orchestra.run.smithi071.stdout:78 write 0xba69b82 thru 0xba69ea7 (0x326 bytes) 2024-09-14T07:11:55.617 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.617 INFO:teuthology.orchestra.run.smithi071.stdout:81 read 0x9fb2348 thru 0x9fc06a3 (0xe35c bytes) 2024-09-14T07:11:55.626 INFO:teuthology.orchestra.run.smithi071.stdout:83 writesame 0xcb0847c thru 0xcb0e12d data_size 0x46(0x5cb2 bytes) 2024-09-14T07:11:55.626 INFO:teuthology.orchestra.run.smithi071.stdout:84 punch from 0x5c7e0e8 to 0x5c7f704, (0x161c bytes) 2024-09-14T07:11:55.627 INFO:teuthology.orchestra.run.smithi071.stdout:86 read 0x789a468 thru 0x789f18f (0x4d28 bytes) 2024-09-14T07:11:55.627 INFO:teuthology.orchestra.run.smithi071.stdout:87 write 0x2f6ba63 thru 0x2f7b530 (0xface bytes) 2024-09-14T07:11:55.628 INFO:teuthology.orchestra.run.smithi071.stdout:91 writesame 0xbe5a439 thru 0xbe5e2bf data_size 0x1(0x3e87 bytes) 2024-09-14T07:11:55.638 INFO:teuthology.orchestra.run.smithi071.stdout:92 read 0x6adb1d4 thru 0x6adf752 (0x457f bytes) 2024-09-14T07:11:55.638 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.638 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.638 INFO:teuthology.orchestra.run.smithi071.stdout:96 writesame 0x29f00d9 thru 0x29fc764 data_size 0x61(0xc68c bytes) 2024-09-14T07:11:55.650 INFO:teuthology.orchestra.run.smithi071.stdout:99 write 0xe791dd4 thru 0xe798297 (0x64c4 bytes) 2024-09-14T07:11:55.653 INFO:teuthology.orchestra.run.smithi071.stdout:101 write 0x24edbfa thru 0x24f3a93 (0x5e9a bytes) 2024-09-14T07:11:55.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:11:55.657 INFO:teuthology.orchestra.run.smithi071.stdout:102 punch from 0x15bc50b to 0x15c79b9, (0xb4ae bytes) 2024-09-14T07:11:55.657 INFO:teuthology.orchestra.run.smithi071.stdout:103 punch from 0x622758b to 0x6229ad0, (0x2545 bytes) 2024-09-14T07:11:55.657 INFO:teuthology.orchestra.run.smithi071.stdout:104 write 0xdbf682d thru 0xdbf849f (0x1c73 bytes) 2024-09-14T07:11:55.659 INFO:teuthology.orchestra.run.smithi071.stdout:105 write 0x93e9bd9 thru 0x93f052c (0x6954 bytes) 2024-09-14T07:11:55.662 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:55.662 INFO:teuthology.orchestra.run.smithi071.stdout:112 punch from 0x9f87413 to 0x9f931f1, (0xbdde bytes) 2024-09-14T07:11:55.662 INFO:teuthology.orchestra.run.smithi071.stdout:113 read 0xaaecc0b thru 0xaaf1e4c (0x5242 bytes) 2024-09-14T07:11:55.662 INFO:teuthology.orchestra.run.smithi071.stdout:114 read 0xb4200a7 thru 0xb424841 (0x479b bytes) 2024-09-14T07:11:55.662 INFO:teuthology.orchestra.run.smithi071.stdout:115 writesame 0xd202e0b thru 0xd20972f data_size 0x1(0x6925 bytes) 2024-09-14T07:11:55.675 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:55.675 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:55.677 INFO:teuthology.orchestra.run.smithi071.stdout:116 clone 1 order 23 su 4194304 sc 4 2024-09-14T07:11:55.684 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:11:55.728 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:55.727+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:55.786 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:55.786 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:55.790 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:55.789+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:55.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:11:55.891 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:55.890+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:55.937 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:55.937 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:55.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:11:55.992 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:55.991+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:56.049 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.049 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:11:56.099 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:56.098+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:56.194 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:56.193+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:56.201 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.201 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:11:56.295 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:56.294+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:56.312 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.312 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:11:56.395 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:56.395+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:56.423 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.424 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.432 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:11:56.517 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:56.516+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:56.574 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.574 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:11:56.597 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:56.596+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:56.649 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:11:56.707 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:56.706+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:56.731 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.731 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:11:56.799 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:56.798+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:56.841 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:56.842 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:56.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:11:56.860 INFO:teuthology.orchestra.run.smithi071.stdout:117 trunc from 0xe798298 to 0x9ff9122 2024-09-14T07:11:56.872 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:56.880 INFO:teuthology.orchestra.run.smithi071.stdout:119 writesame 0xc70cb93 thru 0xc71799a data_size 0x4(0xae08 bytes) 2024-09-14T07:11:56.882 INFO:teuthology.orchestra.run.smithi071.stdout:120 trunc from 0xc71799b to 0xac8d29b 2024-09-14T07:11:56.895 INFO:teuthology.orchestra.run.smithi071.stdout:121 writesame 0xba94e9d thru 0xbaa19d1 data_size 0x1(0xcb35 bytes) 2024-09-14T07:11:56.897 INFO:teuthology.orchestra.run.smithi071.stdout:122 trunc from 0xbaa19d2 to 0xa1dafbd 2024-09-14T07:11:56.899 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:56.898+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:56.914 INFO:teuthology.orchestra.run.smithi071.stdout:123 trunc from 0xa1dafbd to 0x10ddd75 2024-09-14T07:11:56.934 INFO:teuthology.orchestra.run.smithi071.stdout:124 read 0x8a49e6 thru 0x8a5839 (0xe54 bytes) 2024-09-14T07:11:56.942 INFO:teuthology.orchestra.run.smithi071.stdout:125 trunc from 0x10ddd75 to 0x6f11c45 2024-09-14T07:11:56.950 INFO:teuthology.orchestra.run.smithi071.stdout:127 trunc from 0x6f11c45 to 0x5076f3b 2024-09-14T07:11:56.971 INFO:teuthology.orchestra.run.smithi071.stdout:128 write 0xd9ed73c thru 0xd9f83db (0xaca0 bytes) 2024-09-14T07:11:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:131 punch from 0xd9189c5 to 0xd91bdd0, (0x340b bytes) 2024-09-14T07:11:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:132 read 0x88619cc thru 0x886a61f (0x8c54 bytes) 2024-09-14T07:11:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:133 read 0xb30d13 thru 0xb338b6 (0x2ba4 bytes) 2024-09-14T07:11:56.976 INFO:teuthology.orchestra.run.smithi071.stdout:134 punch from 0x1d15a6a to 0x1d22c9e, (0xd234 bytes) 2024-09-14T07:11:56.982 INFO:teuthology.orchestra.run.smithi071.stdout:135 write 0xdd0c386 thru 0xdd1148f (0x510a bytes) 2024-09-14T07:11:56.985 INFO:teuthology.orchestra.run.smithi071.stdout:136 write 0x1250f60 thru 0x1257ae7 (0x6b88 bytes) 2024-09-14T07:11:56.986 INFO:teuthology.orchestra.run.smithi071.stdout:138 punch from 0xb8dc7f3 to 0xb8eaf71, (0xe77e bytes) 2024-09-14T07:11:56.986 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:56.986 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:56.987 INFO:teuthology.orchestra.run.smithi071.stdout:142 write 0xa84f9e thru 0xa8d5c7 (0x862a bytes) 2024-09-14T07:11:56.989 INFO:teuthology.orchestra.run.smithi071.stdout:143 write 0x14b1376 thru 0x14b4f28 (0x3bb3 bytes) 2024-09-14T07:11:56.990 INFO:teuthology.orchestra.run.smithi071.stdout:145 write 0xa218978 thru 0xa223028 (0xa6b1 bytes) 2024-09-14T07:11:56.996 INFO:teuthology.orchestra.run.smithi071.stdout:146 punch from 0x2cbe1a3 to 0x2ccd9b7, (0xf814 bytes) 2024-09-14T07:11:56.996 INFO:teuthology.orchestra.run.smithi071.stdout:147 read 0x56578ad thru 0x565cb81 (0x52d5 bytes) 2024-09-14T07:11:56.996 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:56.996 INFO:teuthology.orchestra.run.smithi071.stdout:149 writesame 0x8b27e1d thru 0x8b2c9fb data_size 0x1(0x4bdf bytes) 2024-09-14T07:11:57.000 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:56.999+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:57.002 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:57.002 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:57.006 INFO:teuthology.orchestra.run.smithi071.stdout:152 write 0x700c108 thru 0x701600f (0x9f08 bytes) 2024-09-14T07:11:57.010 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.010 INFO:teuthology.orchestra.run.smithi071.stdout:156 read 0x3c86cb6 thru 0x3c89276 (0x25c1 bytes) 2024-09-14T07:11:57.010 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.010 INFO:teuthology.orchestra.run.smithi071.stdout:161 read 0x9d0bb6a thru 0x9d16bab (0xb042 bytes) 2024-09-14T07:11:57.010 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.011 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.011 INFO:teuthology.orchestra.run.smithi071.stdout:164 write 0x148faa0 thru 0x149743c (0x799d bytes) 2024-09-14T07:11:57.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:11:57.012 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.016 INFO:teuthology.orchestra.run.smithi071.stdout:166 trunc from 0xdd11490 to 0x9fddc2e 2024-09-14T07:11:57.029 INFO:teuthology.orchestra.run.smithi071.stdout:167 read 0xcecc31 thru 0xcf1dd9 (0x51a9 bytes) 2024-09-14T07:11:57.029 INFO:teuthology.orchestra.run.smithi071.stdout:168 read 0x948976d thru 0x9495a6f (0xc303 bytes) 2024-09-14T07:11:57.029 INFO:teuthology.orchestra.run.smithi071.stdout:169 punch from 0xc37600 to 0xc4193e, (0xa33e bytes) 2024-09-14T07:11:57.029 INFO:teuthology.orchestra.run.smithi071.stdout:170 write 0x83085ca thru 0x8317bc3 (0xf5fa bytes) 2024-09-14T07:11:57.032 INFO:teuthology.orchestra.run.smithi071.stdout:171 write 0x2df3176 thru 0x2e01033 (0xdebe bytes) 2024-09-14T07:11:57.036 INFO:teuthology.orchestra.run.smithi071.stdout:173 read 0x31ecf29 thru 0x31f70ef (0xa1c7 bytes) 2024-09-14T07:11:57.037 INFO:teuthology.orchestra.run.smithi071.stdout:175 punch from 0x9c63978 to 0x9c67fc0, (0x4648 bytes) 2024-09-14T07:11:57.043 INFO:teuthology.orchestra.run.smithi071.stdout:176 write 0xb0655e6 thru 0xb068ecd (0x38e8 bytes) 2024-09-14T07:11:57.047 INFO:teuthology.orchestra.run.smithi071.stdout:177 read 0xd58cb2 thru 0xd5f5bc (0x690b bytes) 2024-09-14T07:11:57.047 INFO:teuthology.orchestra.run.smithi071.stdout:181 write 0x604be01 thru 0x60578fb (0xbafb bytes) 2024-09-14T07:11:57.049 INFO:teuthology.orchestra.run.smithi071.stdout:182 punch from 0x848673a to 0x848f49e, (0x8d64 bytes) 2024-09-14T07:11:57.049 INFO:teuthology.orchestra.run.smithi071.stdout:183 read 0x1092718 thru 0x109375b (0x1044 bytes) 2024-09-14T07:11:57.049 INFO:teuthology.orchestra.run.smithi071.stdout:184 punch from 0xaef55cc to 0xaeff418, (0x9e4c bytes) 2024-09-14T07:11:57.050 INFO:teuthology.orchestra.run.smithi071.stdout:185 punch from 0x181cb10 to 0x182262b, (0x5b1b bytes) 2024-09-14T07:11:57.050 INFO:teuthology.orchestra.run.smithi071.stdout:186 read 0x4f9f661 thru 0x4fa55d1 (0x5f71 bytes) 2024-09-14T07:11:57.050 INFO:teuthology.orchestra.run.smithi071.stdout:188 read 0x10b3283 thru 0x10b7ecd (0x4c4b bytes) 2024-09-14T07:11:57.057 INFO:teuthology.orchestra.run.smithi071.stdout:189 trunc from 0xb068ece to 0x48b35b7 2024-09-14T07:11:57.072 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.082 INFO:teuthology.orchestra.run.smithi071.stdout:192 write 0x6dfae50 thru 0x6dfb172 (0x323 bytes) 2024-09-14T07:11:57.086 INFO:teuthology.orchestra.run.smithi071.stdout:193 read 0xa3bff thru 0xa3f7f (0x381 bytes) 2024-09-14T07:11:57.086 INFO:teuthology.orchestra.run.smithi071.stdout:195 read 0x56c2f1 thru 0x56c4bf (0x1cf bytes) 2024-09-14T07:11:57.100 INFO:teuthology.orchestra.run.smithi071.stdout:196 writesame 0xc305933 thru 0xc307b8d data_size 0x1(0x225b bytes) 2024-09-14T07:11:57.100 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.101 INFO:teuthology.orchestra.run.smithi071.stdout:198 read 0x802831f thru 0x8029cce (0x19b0 bytes) 2024-09-14T07:11:57.101 INFO:teuthology.orchestra.run.smithi071.stdout:199 read 0x3ef6978 thru 0x3ef8499 (0x1b22 bytes) 2024-09-14T07:11:57.101 INFO:teuthology.orchestra.run.smithi071.stdout:202 writesame 0xb958a7a thru 0xb95a750 data_size 0x17(0x1cd7 bytes) 2024-09-14T07:11:57.101 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:57.100+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:57.107 INFO:teuthology.orchestra.run.smithi071.stdout:203 read 0x301e9ea thru 0x30299f1 (0xb008 bytes) 2024-09-14T07:11:57.107 INFO:teuthology.orchestra.run.smithi071.stdout:204 punch from 0x625bd19 to 0x625c385, (0x66c bytes) 2024-09-14T07:11:57.107 INFO:teuthology.orchestra.run.smithi071.stdout:205 write 0x440da96 thru 0x4414026 (0x6591 bytes) 2024-09-14T07:11:57.116 INFO:teuthology.orchestra.run.smithi071.stdout:206 trunc from 0xc307b8e to 0x660a28b 2024-09-14T07:11:57.136 INFO:teuthology.orchestra.run.smithi071.stdout:207 write 0x27fd6e1 thru 0x2809562 (0xbe82 bytes) 2024-09-14T07:11:57.149 INFO:teuthology.orchestra.run.smithi071.stdout:208 write 0x7e5916e thru 0x7e5cea6 (0x3d39 bytes) 2024-09-14T07:11:57.152 INFO:teuthology.orchestra.run.smithi071.stdout:209 write 0x4f4efbb thru 0x4f55b1e (0x6b64 bytes) 2024-09-14T07:11:57.157 INFO:teuthology.orchestra.run.smithi071.stdout:210 read 0x4c7f972 thru 0x4c861f1 (0x6880 bytes) 2024-09-14T07:11:57.157 INFO:teuthology.orchestra.run.smithi071.stdout:211 write 0x222a9c4 thru 0x222ca33 (0x2070 bytes) 2024-09-14T07:11:57.164 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:57.164 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:57.167 INFO:teuthology.orchestra.run.smithi071.stdout:212 write 0x9767b5b thru 0x9769237 (0x16dd bytes) 2024-09-14T07:11:57.170 INFO:teuthology.orchestra.run.smithi071.stdout:214 write 0x6d900e4 thru 0x6d9c0e7 (0xc004 bytes) 2024-09-14T07:11:57.172 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.172 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:57.172 INFO:teuthology.orchestra.run.smithi071.stdout:219 punch from 0x8ed967 to 0x8faad5, (0xd16e bytes) 2024-09-14T07:11:57.172 INFO:teuthology.orchestra.run.smithi071.stdout:220 clone 2 order 23 su 1048576 sc 9 2024-09-14T07:11:57.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:11:57.201 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:57.200+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:57.276 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:57.276 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:57.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:11:57.301 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T07:11:57.301 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:11:57.301 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-14T07:11:57.301 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T07:11:57.302 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T07:11:57.302 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-14T07:11:57.328 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:57.327+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:57.387 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:57.387 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:57.396 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:11:57.403 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:11:57.402+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:11:57.404 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:57.404 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T07:11:57.404 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:57.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:11:57.523 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:57.522+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:57.541 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:57.541 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:57.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:11:57.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:11:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:11:57.605 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:57.604+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:57.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:11:57.619 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:11:57.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:11:57.634 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:11:57.650 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:11:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:11:57.669 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:11:57.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:11:57.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:11:57.687 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:11:57.701 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:57.701 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:57.702 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:57.702 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:57.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:11:57.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:11:57.706 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:57.705+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:57.712 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:11:57.720 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone1 from 0x9769238 (overlap 0x10ddd75) to 0x0 2024-09-14T07:11:57.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:11:57.723 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:11:57.767 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-14T07:11:57.846 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:57.845+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:57.850 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:11:57.850 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:11:57.850 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:57.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:11:57.948 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:57.947+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4238.0:5 2.2 e21/19 2:5cea7035:::rbd_info:head v 21'1, mlcod=0'0)", 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:43.169090+0000", 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.842504899, 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099791000000000007, 2024-09-14T07:11:58.014 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169090+0000", 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169090+0000", 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169091+0000", 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9000000000000001e-07 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169097+0000", 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0870000000000003e-06 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169109+0000", 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2695e-05 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169120+0000", 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0761000000000001e-05 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169176+0000", 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5834000000000001e-05 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.169202+0000", 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6361000000000001e-05 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.170047+0000", 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084427600000000003 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:43.170088+0000", 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1705999999999997e-05 2024-09-14T07:11:58.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4238.0:7 2.2 e22/19 2:5cea7035:::rbd_info:head v 22'2, mlcod=0'0)", 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.838467601, 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084279600000000004, 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173128+0000", 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.92e-07 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173135+0000", 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0570000000000004e-06 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173146+0000", 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0635000000000001e-05 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173157+0000", 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0968000000000001e-05 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173218+0000", 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1338000000000001e-05 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173236+0000", 2024-09-14T07:11:58.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179e-05 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173922+0000", 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068598900000000002 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:44.173970+0000", 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8437999999999999e-05 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3680802290000003, 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00089881800000000001, 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643515+0000", 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6399999999999998e-07 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643521+0000", 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7320000000000003e-06 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643532+0000", 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1267000000000001e-05 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643542+0000", 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0010000000000001e-05 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643591+0000", 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8309000000000001e-05 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.643606+0000", 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5252000000000001e-05 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.644374+0000", 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076763099999999996 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:53.644414+0000", 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0352999999999998e-05 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:682 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.693839+0000", 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.31775647899999998, 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001419972, 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 682 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693839+0000", 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693839+0000", 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693840+0000", 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693849+0000", 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8929999999999994e-06 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693866+0000", 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.628e-05 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693874+0000", 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3329999999999997e-06 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.693929+0000", 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4783e-05 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694028+0000", 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9519999999999996e-05 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694157+0000", 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012851799999999999 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694985+0000", 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082786899999999996 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695196+0000", 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021138600000000001 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695230+0000", 2024-09-14T07:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4311999999999999e-05 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695259+0000", 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8459e-05 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4482.0:682 3.0 e27/23 ondisk, result = 0)", 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.695108+0000", 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.31648765000000001, 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157288, 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695108+0000", 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695108+0000", 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695108+0000", 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695113+0000", 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8300000000000003e-06 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695126+0000", 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2889e-05 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695134+0000", 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5850000000000002e-06 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695187+0000", 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2812999999999997e-05 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695193+0000", 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2040000000000002e-06 2024-09-14T07:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695265+0000", 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2145999999999997e-05 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:686 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.705096+0000", 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.30649964699999999, 2024-09-14T07:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022148900000000001, 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 686 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705096+0000", 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705096+0000", 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705097+0000", 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8369999999999999e-06 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705107+0000", 2024-09-14T07:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0960000000000007e-06 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705124+0000", 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7782999999999999e-05 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705132+0000", 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.498e-06 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705195+0000", 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2669000000000006e-05 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705251+0000", 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6873000000000002e-05 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705317+0000", 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5733000000000002e-05 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:687 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.705404+0000", 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.306191188, 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036659000000000003, 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 687 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705404+0000", 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705404+0000", 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705405+0000", 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4600000000000004e-07 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705408+0000", 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0240000000000002e-06 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705416+0000", 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8210000000000002e-06 2024-09-14T07:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705420+0000", 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0520000000000003e-06 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705456+0000", 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6604999999999999e-05 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705503+0000", 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6563000000000001e-05 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.705771+0000", 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000267879 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:721 3.19 3:9fdf036a:::rbd_data.1182c9370f88.0000000000000004:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.725625+0000", 2024-09-14T07:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.28596988400000001, 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021979030000000002, 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 721 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725625+0000", 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725625+0000", 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725627+0000", 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7400000000000001e-06 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725637+0000", 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0311e-05 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725654+0000", 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6609e-05 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725663+0000", 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5339999999999999e-06 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725722+0000", 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9673999999999998e-05 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725805+0000", 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3115000000000006e-05 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726025+0000", 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021964799999999999 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727486+0000", 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001461246 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727745+0000", 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000258435 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727780+0000", 2024-09-14T07:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5265000000000002e-05 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727823+0000", 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3325999999999998e-05 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:728 3.0 3:00096879:::rbd_data.1182c9370f88.0000000000000011:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.28590112499999998, 2024-09-14T07:11:58.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027950090000000002, 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 728 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725695+0000", 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0699999999999997e-07 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725698+0000", 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8949999999999998e-06 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725704+0000", 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6579999999999996e-06 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725710+0000", 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6409999999999999e-06 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725762+0000", 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2096999999999999e-05 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725828+0000", 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6215000000000002e-05 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726022+0000", 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019395299999999999 2024-09-14T07:11:58.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727647+0000", 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001624782 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728429+0000", 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078201699999999998 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728458+0000", 2024-09-14T07:11:58.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9229000000000001e-05 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728489+0000", 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0914999999999998e-05 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:725 3.8 e28/23 3:1699f8bf:::rbd_data.1182c9370f88.0000000000000009:head v 28'4, mlcod=27'1)", 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.726047+0000", 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.28554867299999998, 2024-09-14T07:11:58.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019809659999999998, 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726047+0000", 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726047+0000", 2024-09-14T07:11:58.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726047+0000", 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0800000000000001e-07 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726052+0000", 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8420000000000004e-06 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726060+0000", 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0180000000000001e-06 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726066+0000", 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000001e-06 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726144+0000", 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8053999999999995e-05 2024-09-14T07:11:58.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726162+0000", 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8e-05 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727995+0000", 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018332470000000001 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728028+0000", 2024-09-14T07:11:58.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2487000000000003e-05 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:726 3.8 e28/23 3:17b00a5d:::rbd_data.1182c9370f88.000000000000000b:head v 28'6, mlcod=27'1)", 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.727024+0000", 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.284570922, 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002367765, 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727024+0000", 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727024+0000", 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727025+0000", 2024-09-14T07:11:58.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2999999999999999e-07 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727035+0000", 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5270000000000004e-06 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727048+0000", 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2778e-05 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727055+0000", 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1459999999999999e-06 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727100+0000", 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5179000000000002e-05 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727119+0000", 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8623000000000001e-05 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729353+0000", 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002233961 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729392+0000", 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9620999999999999e-05 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4482.0:728 3.0 e28/23 ondisk, result = 0)", 2024-09-14T07:11:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.727569+0000", 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.284026481, 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5922999999999997e-05, 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727569+0000", 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727569+0000", 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727570+0000", 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2200000000000002e-07 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727574+0000", 2024-09-14T07:11:58.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6750000000000001e-06 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727583+0000", 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0250000000000008e-06 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727590+0000", 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.849e-06 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727634+0000", 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3331000000000002e-05 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727641+0000", 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7100000000000007e-06 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727655+0000", 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3410999999999999e-05 2024-09-14T07:11:58.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4482.0:721 3.19 e28/23 ondisk, result = 0)", 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.727678+0000", 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.283917166, 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014951799999999999, 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727678+0000", 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727678+0000", 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727679+0000", 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.99e-07 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727682+0000", 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3579999999999999e-06 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727689+0000", 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2799999999999998e-06 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727693+0000", 2024-09-14T07:11:58.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0929999999999996e-06 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727732+0000", 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8942000000000001e-05 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727739+0000", 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0210000000000002e-06 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727828+0000", 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8225000000000003e-05 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:745 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.744229+0000", 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.26736653599999999, 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024542599999999998, 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 745 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744229+0000", 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744229+0000", 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744232+0000", 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.835e-06 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744243+0000", 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1372000000000001e-05 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744266+0000", 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2728e-05 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744276+0000", 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744346+0000", 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0511000000000003e-05 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744410+0000", 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3619000000000002e-05 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744474+0000", 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4182000000000003e-05 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:746 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.744562+0000", 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.26703375400000001, 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020324399999999999, 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 746 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744562+0000", 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744562+0000", 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744562+0000", 2024-09-14T07:11:58.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3e-07 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744566+0000", 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7400000000000002e-06 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744573+0000", 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1500000000000002e-06 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744577+0000", 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.788e-06 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744613+0000", 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6358e-05 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744664+0000", 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0782999999999998e-05 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.744765+0000", 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100695 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:814 3.19 3:981ee40b:::rbd_data.1182f1e71464.0000000000000012:head [sparse-read 0~38709] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.819892+0000", 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.19170310099999999, 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00083956199999999997, 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.086 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 814 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819892+0000", 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819892+0000", 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819894+0000", 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0870000000000001e-06 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819902+0000", 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2490000000000004e-06 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819925+0000", 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3181999999999999e-05 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819946+0000", 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1656999999999999e-05 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820033+0000", 2024-09-14T07:11:58.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6236000000000006e-05 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820111+0000", 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8844000000000006e-05 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820732+0000", 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062030699999999995 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:817 3.4 3:244ef1d8:::rbd_data.1182f1e71464.0000000000000015:head [sparse-read 0~13257] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.819981+0000", 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.19161439799999999, 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058962100000000003, 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-09-14T07:11:58.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819981+0000", 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819981+0000", 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819982+0000", 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2300000000000001e-07 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819985+0000", 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8809999999999998e-06 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.819994+0000", 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.106e-06 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820000+0000", 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2929999999999997e-06 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820059+0000", 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9694999999999997e-05 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820132+0000", 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2430999999999998e-05 2024-09-14T07:11:58.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820571+0000", 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043859200000000002 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:826 3.4 3:25125bbf:::rbd_data.1182f1e71464.000000000000001e:head [sparse-read 0~10073] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.820749+0000", 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.19084622000000001, 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053075699999999997, 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.096 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820749+0000", 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820749+0000", 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820750+0000", 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0299999999999998e-07 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820755+0000", 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9559999999999996e-06 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820763+0000", 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5210000000000002e-06 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820771+0000", 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5499999999999997e-06 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820825+0000", 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4187999999999997e-05 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.820894+0000", 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8612e-05 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821280+0000", 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000386127 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:843 3.4 3:208c38f4:::rbd_data.1182f1e71464.000000000000002f:head [sparse-read 0~50588] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.821345+0000", 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.19025004500000001, 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075081799999999999, 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821345+0000", 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821345+0000", 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821346+0000", 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821352+0000", 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6289999999999998e-06 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821392+0000", 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9768999999999998e-05 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821400+0000", 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4169999999999992e-06 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821456+0000", 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5662999999999999e-05 2024-09-14T07:11:58.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.821522+0000", 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6387e-05 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.822096+0000", 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057396400000000005 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.104 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:58.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:222 write 0x7952eb4 thru 0x795efef (0xc13c bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:223 write 0x5af9581 thru 0x5b06f13 (0xd993 bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:224 writesame 0x59dc784 thru 0x59eb5d4 data_size 0xa9(0xee51 bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:227 read 0x1dc3132 thru 0x1dcb897 (0x8766 bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:228 read 0x1712189 thru 0x171b92b (0x97a3 bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:229 read 0x5cc6df9 thru 0x5cd3b21 (0xcd29 bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:232 writesame 0x9cc8e19 thru 0x9cd66cb data_size 0x7(0xd8b3 bytes) 2024-09-14T07:11:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:234 punch from 0x7dfb6af to 0x7e06712, (0xb063 bytes) 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:236 read 0x4c29592 thru 0x4c2d251 (0x3cc0 bytes) 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:237 write 0xc6f273e thru 0xc6f84af (0x5d72 bytes) 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:239 write 0x88e45f4 thru 0x88ea699 (0x60a6 bytes) 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:240 write 0x75b72f0 thru 0x75b91a6 (0x1eb7 bytes) 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:241 trunc from 0xc6f84b0 to 0x79a40b1 2024-09-14T07:11:58.109 INFO:teuthology.orchestra.run.smithi071.stdout:242 trunc from 0x79a40b1 to 0x4a6cadf 2024-09-14T07:11:58.109 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:58.105+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:58.130 INFO:teuthology.orchestra.run.smithi071.stdout:243 writesame 0xaaba541 thru 0xaabfec1 data_size 0x1(0x5981 bytes) 2024-09-14T07:11:58.130 INFO:teuthology.orchestra.run.smithi071.stdout:244 punch from 0x5d72694 to 0x5d73144, (0xab0 bytes) 2024-09-14T07:11:58.130 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.130 INFO:teuthology.orchestra.run.smithi071.stdout:246 punch from 0x90d2d6 to 0x919c43, (0xc96d bytes) 2024-09-14T07:11:58.131 INFO:teuthology.orchestra.run.smithi071.stdout:249 read 0x2f03574 thru 0x2f0f4a6 (0xbf33 bytes) 2024-09-14T07:11:58.136 INFO:teuthology.orchestra.run.smithi071.stdout:250 trunc from 0xaabfec2 to 0x58d1a2c 2024-09-14T07:11:58.146 INFO:teuthology.orchestra.run.smithi071.stdout:251 read 0x3a7ce0b thru 0x3a880dd (0xb2d3 bytes) 2024-09-14T07:11:58.159 INFO:teuthology.orchestra.run.smithi071.stdout:253 write 0xbcde28f thru 0xbce9fca (0xbd3c bytes) 2024-09-14T07:11:58.162 INFO:teuthology.orchestra.run.smithi071.stdout:254 punch from 0x11555cd to 0x1157eac, (0x28df bytes) 2024-09-14T07:11:58.162 INFO:teuthology.orchestra.run.smithi071.stdout:257 read 0x63dfa5e thru 0x63dfd8c (0x32f bytes) 2024-09-14T07:11:58.168 INFO:teuthology.orchestra.run.smithi071.stdout:258 trunc from 0xbce9fcb to 0x772399e 2024-09-14T07:11:58.180 INFO:teuthology.orchestra.run.smithi071.stdout:259 read 0x9aa869 thru 0x9acb47 (0x22df bytes) 2024-09-14T07:11:58.184 INFO:teuthology.orchestra.run.smithi071.stdout:260 trunc from 0x772399e to 0x9f3c566 2024-09-14T07:11:58.189 INFO:teuthology.orchestra.run.smithi071.stdout:262 punch from 0x8064a36 to 0x8065efe, (0x14c8 bytes) 2024-09-14T07:11:58.189 INFO:teuthology.orchestra.run.smithi071.stdout:263 write 0x4556941 thru 0x4562f4b (0xc60b bytes) 2024-09-14T07:11:58.193 INFO:teuthology.orchestra.run.smithi071.stdout:264 read 0x392fa64 thru 0x3936a54 (0x6ff1 bytes) 2024-09-14T07:11:58.194 INFO:teuthology.orchestra.run.smithi071.stdout:265 read 0x1647b13 thru 0x16554b2 (0xd9a0 bytes) 2024-09-14T07:11:58.194 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.194 INFO:teuthology.orchestra.run.smithi071.stdout:269 read 0x13ab51e thru 0x13b51a8 (0x9c8b bytes) 2024-09-14T07:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout:270 write 0xe6865fe thru 0xe693412 (0xce15 bytes) 2024-09-14T07:11:58.206 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:58.205+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout:truncating to largest ever: 0xedd825a 2024-09-14T07:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout:272 trunc from 0xe693413 to 0xedd825a 2024-09-14T07:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout:276 write 0xa200189 thru 0xa20595c (0x57d4 bytes) 2024-09-14T07:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout:277 writesame 0x27b7cc thru 0x27ec83 data_size 0x1c(0x34b8 bytes) 2024-09-14T07:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout:279 write 0xcaac62f thru 0xcab746c (0xae3e bytes) 2024-09-14T07:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout:280 read 0x770ea4c thru 0x770ec9f (0x254 bytes) 2024-09-14T07:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout:282 read 0x486a97e thru 0x486fdc9 (0x544c bytes) 2024-09-14T07:11:58.226 INFO:teuthology.orchestra.run.smithi071.stdout:283 write 0x94e90ca thru 0x94f23ce (0x9305 bytes) 2024-09-14T07:11:58.227 INFO:teuthology.orchestra.run.smithi071.stdout:284 write 0x9814f18 thru 0x981aaa0 (0x5b89 bytes) 2024-09-14T07:11:58.231 INFO:teuthology.orchestra.run.smithi071.stdout:285 read 0x7d759bf thru 0x7d81805 (0xbe47 bytes) 2024-09-14T07:11:58.231 INFO:teuthology.orchestra.run.smithi071.stdout:286 writesame 0x227d6b8 thru 0x22876c2 data_size 0x7(0xa00b bytes) 2024-09-14T07:11:58.237 INFO:teuthology.orchestra.run.smithi071.stdout:287 read 0x6378762 thru 0x6384392 (0xbc31 bytes) 2024-09-14T07:11:58.237 INFO:teuthology.orchestra.run.smithi071.stdout:288 read 0x4245cc thru 0x429582 (0x4fb7 bytes) 2024-09-14T07:11:58.238 INFO:teuthology.orchestra.run.smithi071.stdout:289 writesame 0x24b55b9 thru 0x24c0620 data_size 0x14(0xb068 bytes) 2024-09-14T07:11:58.242 INFO:teuthology.orchestra.run.smithi071.stdout:290 write 0x6742e0d thru 0x6746c2e (0x3e22 bytes) 2024-09-14T07:11:58.247 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:58.247 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:58.247 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:58.247 INFO:teuthology.orchestra.run.smithi071.stdout:292 trunc from 0xedd825a to 0xcb75b17 2024-09-14T07:11:58.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:11:58.268 INFO:teuthology.orchestra.run.smithi071.stdout:293 clone 3 order 21 su 65536 sc 2 2024-09-14T07:11:58.312 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:58.311+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:58.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:11:58.408 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:58.407+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:58.509 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:58.508+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:58.521 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4238.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.357655864000002, 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090097599999999995, 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163544+0000", 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9500000000000001e-07 2024-09-14T07:11:58.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163548+0000", 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8449999999999996e-06 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163557+0000", 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2499999999999995e-06 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163565+0000", 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.106e-06 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163603+0000", 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7758e-05 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.163624+0000", 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0721e-05 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.164409+0000", 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078467499999999998 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:42.164445+0000", 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6426e-05 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:682 3.0 e28/23 3:04479396:::rbd_id.image_client.0-clone2:head v 28'2, mlcod=0'0)", 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.694281+0000", 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.82691912099999998, 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078567700000000003, 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694281+0000", 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694281+0000", 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694281+0000", 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694287+0000", 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6330000000000001e-06 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694301+0000", 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4467999999999999e-05 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694310+0000", 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4209999999999995e-06 2024-09-14T07:11:58.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694369+0000", 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9002999999999997e-05 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.694392+0000", 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3054e-05 2024-09-14T07:11:58.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695034+0000", 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064285199999999996 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.695066+0000", 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2005999999999998e-05 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:728 3.0 e28/23 3:00096879:::rbd_data.1182c9370f88.0000000000000011:head v 28'4, mlcod=27'1)", 2024-09-14T07:11:58.532 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.726526+0000", 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.79467406699999998, 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098813900000000007, 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726526+0000", 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726526+0000", 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726527+0000", 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726537+0000", 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6849999999999996e-06 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726555+0000", 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7963999999999999e-05 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726565+0000", 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8400000000000007e-06 2024-09-14T07:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726633+0000", 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8288999999999996e-05 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726653+0000", 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0514e-05 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727473+0000", 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081930999999999996 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727514+0000", 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1180000000000002e-05 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:878 3.0 e28/23 3:05bfc596:::rbd_data.11822ba09815.0000000000000011:head v 28'5, mlcod=28'2)", 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.043368+0000", 2024-09-14T07:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.477831485, 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097807699999999994, 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043368+0000", 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043368+0000", 2024-09-14T07:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043370+0000", 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.184e-06 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043415+0000", 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043430+0000", 2024-09-14T07:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4688999999999999e-05 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043438+0000", 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2870000000000004e-06 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043502+0000", 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534000000000005e-05 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043525+0000", 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3087000000000001e-05 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.044305+0000", 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078062100000000001 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.044346+0000", 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1170000000000001e-05 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:928 3.0 e28/23 3:05bfc596:::rbd_data.11822ba09815.0000000000000011:head v 28'6, mlcod=28'4)", 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.082571+0000", 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.43862896400000001, 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064528000000000003, 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082571+0000", 2024-09-14T07:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082571+0000", 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082572+0000", 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.533e-06 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082582+0000", 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9320000000000008e-06 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082601+0000", 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8719000000000002e-05 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082612+0000", 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1004e-05 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082673+0000", 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1282e-05 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.082695+0000", 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1656000000000001e-05 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.083174+0000", 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000478915 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.083216+0000", 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:966 3.0 e28/23 3:05bfc596:::rbd_data.11822ba09815.0000000000000011:head v 28'7, mlcod=28'5)", 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.103791+0000", 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.41740891000000002, 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064781099999999998, 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103791+0000", 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103791+0000", 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103792+0000", 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1990000000000001e-06 2024-09-14T07:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103806+0000", 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4055e-05 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103826+0000", 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9539e-05 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103839+0000", 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3287e-05 2024-09-14T07:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103906+0000", 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6828000000000005e-05 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.103921+0000", 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5494000000000001e-05 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.104399+0000", 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047778000000000002 2024-09-14T07:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.104439+0000", 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9629000000000003e-05 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1047 3.0 e28/23 3:06cd0b7a:::rbd_data.11822ba09815.0000000000000006:head v 28'8, mlcod=28'6)", 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.32838551100000002, 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010714940000000001, 2024-09-14T07:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192816+0000", 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.46e-06 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192872+0000", 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6079000000000003e-05 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192890+0000", 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7873e-05 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192899+0000", 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1200000000000008e-06 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192965+0000", 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5675999999999999e-05 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192990+0000", 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5072999999999999e-05 2024-09-14T07:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.193856+0000", 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086668300000000004 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.193886+0000", 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.953e-05 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:58.555 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:11:58.609 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:58.608+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:58.659 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:11:58.659 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:58.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:11:58.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:11:58.711 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:11:58.710+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:11:58.737 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone2 from 0xcb75b17 (overlap 0x4a6cadf) to 0x3b8a24c 2024-09-14T07:11:58.810 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:58.810+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:58.827 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:11:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:11:58.827 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:11:58.827 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:58.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:11:58.849 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-14T07:11:58.851 INFO:teuthology.orchestra.run.smithi071.stdout:294 read 0xa4bc943 thru 0xa4c3e47 (0x7505 bytes) 2024-09-14T07:11:58.851 INFO:teuthology.orchestra.run.smithi071.stdout:295 read 0x964053a thru 0x96469c8 (0x648f bytes) 2024-09-14T07:11:58.851 INFO:teuthology.orchestra.run.smithi071.stdout:297 read 0x51b431e thru 0x51bdc62 (0x9945 bytes) 2024-09-14T07:11:58.852 INFO:teuthology.orchestra.run.smithi071.stdout:298 read 0x9897621 thru 0x989991a (0x22fa bytes) 2024-09-14T07:11:58.852 INFO:teuthology.orchestra.run.smithi071.stdout:299 read 0x12c23a6 thru 0x12c9ee7 (0x7b42 bytes) 2024-09-14T07:11:58.853 INFO:teuthology.orchestra.run.smithi071.stdout:301 write 0x7adac4f thru 0x7adb977 (0xd29 bytes) 2024-09-14T07:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout:302 writesame 0x5102e9b thru 0x5104cc5 data_size 0x1(0x1e2b bytes) 2024-09-14T07:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout:303 read 0xa8d9459 thru 0xa8e184e (0x83f6 bytes) 2024-09-14T07:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout:304 trunc from 0xcb75b17 to 0x9f3754c 2024-09-14T07:11:58.886 INFO:teuthology.orchestra.run.smithi071.stdout:305 punch from 0x3a2b98d to 0x3a3b1e4, (0xf857 bytes) 2024-09-14T07:11:58.886 INFO:teuthology.orchestra.run.smithi071.stdout:307 punch from 0x26b1afe to 0x26bfe9c, (0xe39e bytes) 2024-09-14T07:11:58.888 INFO:teuthology.orchestra.run.smithi071.stdout:308 trunc from 0x9f3754c to 0xbd2cb5b 2024-09-14T07:11:58.894 INFO:teuthology.orchestra.run.smithi071.stdout:309 read 0x80f9316 thru 0x8104813 (0xb4fe bytes) 2024-09-14T07:11:58.902 INFO:teuthology.orchestra.run.smithi071.stdout:310 writesame 0xc664ced thru 0xc66e6f4 data_size 0x7c(0x9a08 bytes) 2024-09-14T07:11:58.902 INFO:teuthology.orchestra.run.smithi071.stdout:312 read 0x2302709 thru 0x230bd4b (0x9643 bytes) 2024-09-14T07:11:58.902 INFO:teuthology.orchestra.run.smithi071.stdout:315 writesame 0x233ec7e thru 0x2342479 data_size 0x2(0x37fc bytes) 2024-09-14T07:11:58.911 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:58.910+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:58.913 INFO:teuthology.orchestra.run.smithi071.stdout:317 write 0x91fda1 thru 0x922510 (0x2770 bytes) 2024-09-14T07:11:58.920 INFO:teuthology.orchestra.run.smithi071.stdout:318 write 0x2a38344 thru 0x2a41f5a (0x9c17 bytes) 2024-09-14T07:11:58.930 INFO:teuthology.orchestra.run.smithi071.stdout:319 punch from 0x520d31 to 0x53087d, (0xfb4c bytes) 2024-09-14T07:11:58.930 INFO:teuthology.orchestra.run.smithi071.stdout:322 read 0x1ab5f0e thru 0x1ac195a (0xba4d bytes) 2024-09-14T07:11:58.930 INFO:teuthology.orchestra.run.smithi071.stdout:323 punch from 0x169cb94 to 0x16a225f, (0x56cb bytes) 2024-09-14T07:11:58.930 INFO:teuthology.orchestra.run.smithi071.stdout:324 write 0x8391a29 thru 0x839b435 (0x9a0d bytes) 2024-09-14T07:11:58.936 INFO:teuthology.orchestra.run.smithi071.stdout:326 read 0x4a43a64 thru 0x4a45774 (0x1d11 bytes) 2024-09-14T07:11:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:327 punch from 0x961ca3f to 0x962c8b7, (0xfe78 bytes) 2024-09-14T07:11:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:329 read 0x530caba thru 0x5314212 (0x7759 bytes) 2024-09-14T07:11:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:331 read 0x4b463d8 thru 0x4b4bdfa (0x5a23 bytes) 2024-09-14T07:11:58.937 INFO:teuthology.orchestra.run.smithi071.stdout:332 read 0x1bf89e5 thru 0x1c0496f (0xbf8b bytes) 2024-09-14T07:11:58.938 INFO:teuthology.orchestra.run.smithi071.stdout:333 punch from 0x6ab92fe to 0x6ac51d9, (0xbedb bytes) 2024-09-14T07:11:58.938 INFO:teuthology.orchestra.run.smithi071.stdout:334 read 0xbd2b51a thru 0xbd2f99a (0x4481 bytes) 2024-09-14T07:11:58.938 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:58.938 INFO:teuthology.orchestra.run.smithi071.stdout:336 writesame 0x1513f64 thru 0x15187c4 data_size 0x1(0x4861 bytes) 2024-09-14T07:11:58.951 INFO:teuthology.orchestra.run.smithi071.stdout:337 read 0x9d4eb3 thru 0x9da485 (0x55d3 bytes) 2024-09-14T07:11:58.966 INFO:teuthology.orchestra.run.smithi071.stdout:339 trunc from 0xc66e6f5 to 0x1c1edc1 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:719 3.b 3:d26a7d7b:::rbd_data.1182c9370f88.0000000000000002:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.722673+0000", 2024-09-14T07:11:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.250490871, 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028123139999999998, 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 719 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722673+0000", 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722673+0000", 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722675+0000", 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1430000000000001e-06 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722685+0000", 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7909999999999999e-06 2024-09-14T07:11:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722707+0000", 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1821999999999999e-05 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722721+0000", 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4763000000000001e-05 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722804+0000", 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2040999999999996e-05 2024-09-14T07:11:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.722917+0000", 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113811 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.723147+0000", 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022953599999999999 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725167+0000", 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020199490000000001 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725388+0000", 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221003 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725437+0000", 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9635999999999997e-05 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725485+0000", 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7818999999999997e-05 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:725 3.8 3:1699f8bf:::rbd_data.1182c9370f88.0000000000000009:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.725639+0000", 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.247524423, 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026259170000000002, 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 725 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725639+0000", 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725639+0000", 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725641+0000", 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1170000000000001e-06 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725646+0000", 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7980000000000002e-06 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725657+0000", 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0728e-05 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725663+0000", 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.451e-06 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725716+0000", 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3733999999999997e-05 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725784+0000", 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7696999999999999e-05 2024-09-14T07:11:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725894+0000", 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0001105 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727733+0000", 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001838569 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728154+0000", 2024-09-14T07:11:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000421032 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728211+0000", 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6916000000000002e-05 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728265+0000", 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4375e-05 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:726 3.8 3:17b00a5d:::rbd_data.1182c9370f88.000000000000000b:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.247469699, 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038570269999999999, 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 726 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725695+0000", 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.61e-07 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725699+0000", 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5789999999999997e-06 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725708+0000", 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6850000000000007e-06 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725715+0000", 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2289999999999997e-06 2024-09-14T07:11:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726565+0000", 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084992200000000003 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726638+0000", 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3034000000000006e-05 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726814+0000", 2024-09-14T07:11:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000176236 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728283+0000", 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014683910000000001 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729493+0000", 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012097849999999999 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729525+0000", 2024-09-14T07:11:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2484999999999998e-05 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729551+0000", 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6020000000000002e-05 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1116 3.b 3:d53ce072:::rbd_data.11822ba09815.0000000000000012:head [truncate 7340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.252413+0000", 2024-09-14T07:11:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.72075086899999996, 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027441509999999998, 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1116 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252413+0000", 2024-09-14T07:11:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252413+0000", 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252415+0000", 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6759999999999999e-06 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252422+0000", 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9500000000000004e-06 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252438+0000", 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5911000000000001e-05 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252446+0000", 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0420000000000003e-06 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252501+0000", 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5831999999999997e-05 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252571+0000", 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9269000000000004e-05 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252654+0000", 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3818000000000003e-05 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.254785+0000", 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021308350000000002 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.255077+0000", 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029176000000000001 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.255113+0000", 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5868000000000003e-05 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.255157+0000", 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4190000000000002e-05 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1117 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:head [truncate 7340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.252464+0000", 2024-09-14T07:11:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.72069943299999994, 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084206439999999997, 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1117 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252464+0000", 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252464+0000", 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252465+0000", 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6899999999999998e-07 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252467+0000", 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2850000000000001e-06 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252475+0000", 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6799999999999993e-06 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252486+0000", 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1148999999999999e-05 2024-09-14T07:11:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252892+0000", 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040611400000000001 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252980+0000", 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7750000000000005e-05 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253118+0000", 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013842800000000001 2024-09-14T07:11:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.257813+0000", 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046946890000000002 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260818+0000", 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003005148 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260848+0000", 2024-09-14T07:11:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9850999999999999e-05 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260885+0000", 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7081e-05 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1209 3.8 3:14853814:::rbd_header.1182823d0fd0:head [call rbd.parent_attach in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.725412+0000", 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.247751479, 2024-09-14T07:11:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002723137, 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1209 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725412+0000", 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725412+0000", 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725413+0000", 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-06 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725418+0000", 2024-09-14T07:11:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9649999999999999e-06 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725431+0000", 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2582000000000001e-05 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725438+0000", 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2679999999999997e-06 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725483+0000", 2024-09-14T07:11:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5083000000000002e-05 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725533+0000", 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9406000000000001e-05 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.725673+0000", 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013986099999999999 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.726114+0000", 2024-09-14T07:11:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044171800000000002 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.728037+0000", 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019229900000000001 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.728091+0000", 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4067999999999998e-05 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.728135+0000", 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4101999999999999e-05 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1231 3.b 3:d53ce072:::rbd_data.11822ba09815.0000000000000012:head [delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.741493+0000", 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.23167093699999999, 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004353198, 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1231 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741493+0000", 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741493+0000", 2024-09-14T07:11:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741495+0000", 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6279999999999999e-06 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741500+0000", 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1200000000000001e-06 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741514+0000", 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4487e-05 2024-09-14T07:11:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741522+0000", 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2439999999999993e-06 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741577+0000", 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4354000000000002e-05 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741638+0000", 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0949999999999998e-05 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741757+0000", 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119134 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745397+0000", 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036406670000000002 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745753+0000", 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035554100000000002 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745804+0000", 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0989000000000003e-05 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745846+0000", 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2083999999999999e-05 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1232 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:head [delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.23162110699999999, 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070039159999999998, 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1232 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741546+0000", 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5299999999999999e-06 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741552+0000", 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7850000000000003e-06 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741558+0000", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5130000000000004e-06 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742315+0000", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075694499999999997 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742389+0000", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3674e-05 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742538+0000", 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149321 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748270+0000", 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00573158 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748453+0000", 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018315599999999999 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748503+0000", 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9848000000000001e-05 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748547+0000", 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4115e-05 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1292 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.759397+0000", 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.21376718, 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024749949999999998, 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1292 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759397+0000", 2024-09-14T07:11:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759397+0000", 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759399+0000", 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9700000000000002e-06 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759431+0000", 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2447999999999998e-05 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759450+0000", 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8893e-05 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759459+0000", 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2629999999999992e-06 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759522+0000", 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2540999999999996e-05 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759671+0000", 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149197 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759951+0000", 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028029999999999998 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761299+0000", 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001348202 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761771+0000", 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047133800000000002 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761829+0000", 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7714999999999999e-05 2024-09-14T07:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761872+0000", 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3127999999999998e-05 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1293 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:head [truncate 7340032] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.759493+0000", 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.213670412, 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033708649999999998, 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1293 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759493+0000", 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759493+0000", 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759494+0000", 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9100000000000003e-07 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759498+0000", 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759506+0000", 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5390000000000007e-06 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759513+0000", 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7700000000000004e-06 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760475+0000", 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096228000000000004 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760560+0000", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4338999999999993e-05 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760732+0000", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017279599999999999 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761732+0000", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010000860000000001 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762799+0000", 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010668800000000001 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762828+0000", 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8702000000000001e-05 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762864+0000", 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6220999999999998e-05 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1444 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:5 [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.873933+0000", 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.099230367, 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024390449999999999, 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1444 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873933+0000", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873933+0000", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873934+0000", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0399999999999996e-07 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873944+0000", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5349999999999993e-06 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873951+0000", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3139999999999998e-06 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873956+0000", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2859999999999999e-06 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876198+0000", 2024-09-14T07:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022421469999999999 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876275+0000", 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6742999999999994e-05 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876373+0000", 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7416000000000004e-05 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1445 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:5 [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.873964+0000", 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.099200001999999995, 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026347670000000001, 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1445 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873964+0000", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873964+0000", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873964+0000", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2e-07 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873967+0000", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873974+0000", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5320000000000001e-06 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873979+0000", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8130000000000003e-06 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876403+0000", 2024-09-14T07:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002424046 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876487+0000", 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4161999999999998e-05 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876599+0000", 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111475 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1446 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:5 [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.099178298999999998, 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028253739999999999, 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1446 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873988+0000", 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7489999999999999e-06 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873994+0000", 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873998+0000", 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0849999999999999e-06 2024-09-14T07:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876628+0000", 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026305209999999998 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876714+0000", 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5500999999999993e-05 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876811+0000", 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7261000000000003e-05 2024-09-14T07:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1447 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.099156200999999999, 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003018789, 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1447 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874011+0000", 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4819999999999999e-06 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874018+0000", 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6309999999999997e-06 2024-09-14T07:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874023+0000", 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1240000000000004e-06 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876858+0000", 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028351100000000001 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876930+0000", 2024-09-14T07:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1181999999999997e-05 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.877026+0000", 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6884000000000003e-05 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1591 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913792+0000", 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.059371578000000001, 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025204540000000001, 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1591 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913792+0000", 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913792+0000", 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913793+0000", 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0500000000000003e-07 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913798+0000", 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3149999999999999e-06 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913805+0000", 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1679999999999998e-06 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913811+0000", 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2669999999999997e-06 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916089+0000", 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022785029999999999 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916179+0000", 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9710999999999995e-05 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916313+0000", 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013388500000000001 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1592 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913826+0000", 2024-09-14T07:11:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.059337903999999997, 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002733868, 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1592 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913826+0000", 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913826+0000", 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913826+0000", 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913829+0000", 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2230000000000001e-06 2024-09-14T07:11:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913835+0000", 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7889999999999997e-06 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913842+0000", 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1530000000000002e-06 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916344+0000", 2024-09-14T07:11:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025020490000000001 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916442+0000", 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8597999999999993e-05 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916560+0000", 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117516 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1593 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.059314081999999997, 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002942933, 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1593 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7100000000000002e-07 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913853+0000", 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2900000000000001e-06 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913859+0000", 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3300000000000004e-06 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913864+0000", 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0329999999999999e-06 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916597+0000", 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002733465 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916687+0000", 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0024000000000004e-05 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916793+0000", 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010532 2024-09-14T07:11:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1594 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913873+0000", 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.059290399000000001, 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031053349999999999, 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1594 2024-09-14T07:11:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913873+0000", 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913873+0000", 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913874+0000", 2024-09-14T07:11:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7399999999999998e-07 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913876+0000", 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0040000000000002e-06 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913882+0000", 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0310000000000004e-06 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913887+0000", 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8250000000000004e-06 2024-09-14T07:11:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916830+0000", 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002943527 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916887+0000", 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6385000000000003e-05 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916979+0000", 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2089000000000005e-05 2024-09-14T07:11:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1595 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.059268953999999999, 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033134089999999998, 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1595 2024-09-14T07:11:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2300000000000002e-07 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913897+0000", 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7910000000000001e-06 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913910+0000", 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2585999999999999e-05 2024-09-14T07:11:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913915+0000", 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1580000000000004e-06 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917019+0000", 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031038189999999998 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917099+0000", 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0150999999999999e-05 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917208+0000", 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109481 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1596 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.059242199000000002, 2024-09-14T07:11:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034916629999999999, 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1596 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1600000000000002e-07 2024-09-14T07:11:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913925+0000", 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913930+0000", 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1120000000000004e-06 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913934+0000", 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.805e-06 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917235+0000", 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033017210000000001 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917316+0000", 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0455000000000001e-05 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:11:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917413+0000", 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7503999999999993e-05 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:11:59.075 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:11:59.077 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:340 trunc from 0x1c1edc1 to 0x2074dd9 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:344 write 0x11890d0 thru 0x118a9c3 (0x18f4 bytes) 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:345 trunc from 0x2074dd9 to 0x81f7292 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:346 writesame 0xcd1dfc0 thru 0xcd2dc1f data_size 0x30(0xfc60 bytes) 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:347 read 0xbdfcd50 thru 0xbe0486e (0x7b1f bytes) 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:348 read 0x55a409c thru 0x55abc65 (0x7bca bytes) 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:351 trunc from 0xcd2dc20 to 0x33b3b1 2024-09-14T07:11:59.079 INFO:teuthology.orchestra.run.smithi071.stdout:353 read 0x1541a9 thru 0x157be3 (0x3a3b bytes) 2024-09-14T07:11:59.079 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.079 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.079 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:59.075+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:59.079 INFO:teuthology.orchestra.run.smithi071.stdout:356 write 0x94f41d8 thru 0x94f8c00 (0x4a29 bytes) 2024-09-14T07:11:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:359 read 0x204a10c thru 0x2053301 (0x91f6 bytes) 2024-09-14T07:11:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:362 flatten 2024-09-14T07:11:59.091 INFO:teuthology.orchestra.run.smithi071.stdout:364 punch from 0x8dc1bcd to 0x8dd00ec, (0xe51f bytes) 2024-09-14T07:11:59.091 INFO:teuthology.orchestra.run.smithi071.stdout:367 write 0xa448c5 thru 0xa48a68 (0x41a4 bytes) 2024-09-14T07:11:59.094 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.094 INFO:teuthology.orchestra.run.smithi071.stdout:369 read 0xaa64df thru 0xaa7137 (0xc59 bytes) 2024-09-14T07:11:59.095 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.099 INFO:teuthology.orchestra.run.smithi071.stdout:373 trunc from 0x94f8c01 to 0x540e393 2024-09-14T07:11:59.121 INFO:teuthology.orchestra.run.smithi071.stdout:374 write 0x6a3a23f thru 0x6a3e9c8 (0x478a bytes) 2024-09-14T07:11:59.123 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.138 INFO:teuthology.orchestra.run.smithi071.stdout:376 writesame 0xde8cd58 thru 0xde971a0 data_size 0x3(0xa449 bytes) 2024-09-14T07:11:59.138 INFO:teuthology.orchestra.run.smithi071.stdout:378 writesame 0xa20a43b thru 0xa210bd5 data_size 0x15(0x679b bytes) 2024-09-14T07:11:59.143 INFO:teuthology.orchestra.run.smithi071.stdout:379 writesame 0x4a65617 thru 0x4a6e976 data_size 0x48(0x9360 bytes) 2024-09-14T07:11:59.154 INFO:teuthology.orchestra.run.smithi071.stdout:380 trunc from 0xde971a1 to 0x706a847 2024-09-14T07:11:59.176 INFO:teuthology.orchestra.run.smithi071.stdout:381 writesame 0xcdd87ee thru 0xcde7148 data_size 0x1(0xe95b bytes) 2024-09-14T07:11:59.176 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.177 INFO:teuthology.orchestra.run.smithi071.stdout:383 trunc from 0xcde7149 to 0xcd17512 2024-09-14T07:11:59.177 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:11:59.176+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:11:59.180 INFO:teuthology.orchestra.run.smithi071.stdout:384 writesame 0x466dd7 thru 0x469be5 data_size 0x1(0x2e0f bytes) 2024-09-14T07:11:59.185 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:11:59.185 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout:385 writesame 0x30790d thru 0x310b40 data_size 0x6(0x9234 bytes) 2024-09-14T07:11:59.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout:386 write 0xcd1ca3b thru 0xcd204bb (0x3a81 bytes) 2024-09-14T07:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout:387 read 0x311c62d thru 0x311ec99 (0x266d bytes) 2024-09-14T07:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout:388 read 0x2aa796b thru 0x2aaf007 (0x769d bytes) 2024-09-14T07:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout:389 write 0xdf94ae0 thru 0xdf99614 (0x4b35 bytes) 2024-09-14T07:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout:390 write 0x903d84b thru 0x90475c9 (0x9d7f bytes) 2024-09-14T07:11:59.214 INFO:teuthology.orchestra.run.smithi071.stdout:391 read 0x661e92e thru 0x6625360 (0x6a33 bytes) 2024-09-14T07:11:59.214 INFO:teuthology.orchestra.run.smithi071.stdout:393 punch from 0x5ff38a2 to 0x5ff765e, (0x3dbc bytes) 2024-09-14T07:11:59.214 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.214 INFO:teuthology.orchestra.run.smithi071.stdout:395 punch from 0xce919e0 to 0xce99bea, (0x820a bytes) 2024-09-14T07:11:59.216 INFO:teuthology.orchestra.run.smithi071.stdout:399 trunc from 0xdf99615 to 0xc8ca655 2024-09-14T07:11:59.239 INFO:teuthology.orchestra.run.smithi071.stdout:400 trunc from 0xc8ca655 to 0xd7bde6 2024-09-14T07:11:59.251 INFO:teuthology.orchestra.run.smithi071.stdout:401 read 0x4ad4d4 thru 0x4addab (0x8d8 bytes) 2024-09-14T07:11:59.251 INFO:teuthology.orchestra.run.smithi071.stdout:402 read 0x32627e thru 0x32f7da (0x955d bytes) 2024-09-14T07:11:59.270 INFO:teuthology.orchestra.run.smithi071.stdout:403 write 0xc3d6a4a thru 0xc3e2793 (0xbd4a bytes) 2024-09-14T07:11:59.278 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:59.277+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:59.279 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.279 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.286 INFO:teuthology.orchestra.run.smithi071.stdout:406 trunc from 0xc3e2794 to 0x6636e3f 2024-09-14T07:11:59.301 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.301 INFO:teuthology.orchestra.run.smithi071.stdout:411 writesame 0x617242c thru 0x617f1c7 data_size 0x2(0xcd9c bytes) 2024-09-14T07:11:59.301 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:59.301 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:59.301 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:11:59.302 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:11:59.302 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:59.313 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:11:59.316 INFO:teuthology.orchestra.run.smithi071.stdout:413 read 0x550250a thru 0x55082d5 (0x5dcc bytes) 2024-09-14T07:11:59.328 INFO:teuthology.orchestra.run.smithi071.stdout:414 writesame 0xbad1235 thru 0xbad243b data_size 0xd(0x1207 bytes) 2024-09-14T07:11:59.328 INFO:teuthology.orchestra.run.smithi071.stdout:415 writesame 0xae94b thru 0xb9af1 data_size 0x49(0xb1a7 bytes) 2024-09-14T07:11:59.329 INFO:teuthology.orchestra.run.smithi071.stdout:416 write 0x4448f39 thru 0x444c8a7 (0x396f bytes) 2024-09-14T07:11:59.332 INFO:teuthology.orchestra.run.smithi071.stdout:417 read 0x6db1239 thru 0x6db446b (0x3233 bytes) 2024-09-14T07:11:59.337 INFO:teuthology.orchestra.run.smithi071.stdout:418 writesame 0xbce3f21 thru 0xbce9708 data_size 0x8(0x57e8 bytes) 2024-09-14T07:11:59.337 INFO:teuthology.orchestra.run.smithi071.stdout:420 read 0x9ad6a29 thru 0x9ae1df2 (0xb3ca bytes) 2024-09-14T07:11:59.337 INFO:teuthology.orchestra.run.smithi071.stdout:421 punch from 0x911ab52 to 0x911e0ac, (0x355a bytes) 2024-09-14T07:11:59.343 INFO:teuthology.orchestra.run.smithi071.stdout:422 trunc from 0xbce9709 to 0x6a0f9b6 2024-09-14T07:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout:423 write 0xb8f5f06 thru 0xb8fb739 (0x5834 bytes) 2024-09-14T07:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout:425 write 0x82858b4 thru 0x828ab8c (0x52d9 bytes) 2024-09-14T07:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout:427 writesame 0xb808f41 thru 0xb80e57f data_size 0x1(0x563f bytes) 2024-09-14T07:11:59.378 INFO:teuthology.orchestra.run.smithi071.stdout:428 read 0xc39ad4 thru 0xc3f46f (0x599c bytes) 2024-09-14T07:11:59.379 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:11:59.378+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:11:59.389 INFO:teuthology.orchestra.run.smithi071.stdout:429 trunc from 0xb8fb73a to 0x2a2cb18 2024-09-14T07:11:59.405 INFO:teuthology.orchestra.run.smithi071.stdout:430 read 0x1df39df thru 0x1df81ea (0x480c bytes) 2024-09-14T07:11:59.405 INFO:teuthology.orchestra.run.smithi071.stdout:431 writesame 0xe9603f thru 0xe9fa6c data_size 0x5(0x9a2e bytes) 2024-09-14T07:11:59.410 INFO:teuthology.orchestra.run.smithi071.stdout:432 read 0x1f22bb7 thru 0x1f2905f (0x64a9 bytes) 2024-09-14T07:11:59.422 INFO:teuthology.orchestra.run.smithi071.stdout:433 write 0x7c306b0 thru 0x7c36ca1 (0x65f2 bytes) 2024-09-14T07:11:59.424 INFO:teuthology.orchestra.run.smithi071.stdout:434 read 0x23995d6 thru 0x23a8537 (0xef62 bytes) 2024-09-14T07:11:59.425 INFO:teuthology.orchestra.run.smithi071.stdout:435 writesame 0x2a74978 thru 0x2a76ef6 data_size 0x1(0x257f bytes) 2024-09-14T07:11:59.430 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.431 INFO:teuthology.orchestra.run.smithi071.stdout:438 read 0x5bda20a thru 0x5bdaf18 (0xd0f bytes) 2024-09-14T07:11:59.431 INFO:teuthology.orchestra.run.smithi071.stdout:439 read 0x4a9ba9c thru 0x4aa715f (0xb6c4 bytes) 2024-09-14T07:11:59.431 INFO:teuthology.orchestra.run.smithi071.stdout:440 writesame 0x39aa3de thru 0x39b4672 data_size 0x1(0xa295 bytes) 2024-09-14T07:11:59.443 INFO:teuthology.orchestra.run.smithi071.stdout:441 punch from 0x664f59c to 0x6651601, (0x2065 bytes) 2024-09-14T07:11:59.443 INFO:teuthology.orchestra.run.smithi071.stdout:442 write 0xee91b4 thru 0xef1a1f (0x886c bytes) 2024-09-14T07:11:59.446 INFO:teuthology.orchestra.run.smithi071.stdout:443 read 0x309d7ee thru 0x30a208c (0x489f bytes) 2024-09-14T07:11:59.453 INFO:teuthology.orchestra.run.smithi071.stdout:444 trunc from 0x7c36ca2 to 0x1e89096 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:53.641271+0000", 2024-09-14T07:11:59.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.8192836899999998, 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033780239999999999, 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641271+0000", 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641271+0000", 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641272+0000", 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.223e-06 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641278+0000", 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2160000000000003e-06 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641289+0000", 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0957e-05 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641299+0000", 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6860000000000001e-06 2024-09-14T07:11:59.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641347+0000", 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8279000000000003e-05 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641351+0000", 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.126e-06 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.643226+0000", 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018752560000000001 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.643295+0000", 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8225000000000005e-05 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.643377+0000", 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2303000000000001e-05 2024-09-14T07:11:59.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644530+0000", 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011526279999999999 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644596+0000", 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6447999999999998e-05 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644625+0000", 2024-09-14T07:11:59.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9153999999999999e-05 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644649+0000", 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3523000000000002e-05 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:10 3.1c e26/23 3:3831950c:::rbd_directory:head v 26'1, mlcod=0'0)", 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:53.647533+0000", 2024-09-14T07:11:59.469 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.8130209370000001, 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002536272, 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647533+0000", 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647533+0000", 2024-09-14T07:11:59.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647534+0000", 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4200000000000002e-07 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647539+0000", 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7990000000000001e-06 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647549+0000", 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0213e-05 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647557+0000", 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8010000000000004e-06 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647607+0000", 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0411999999999998e-05 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.647621+0000", 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3806e-05 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.650041+0000", 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024197279999999999 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.650070+0000", 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9170999999999999e-05 2024-09-14T07:11:59.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:727 3.f e28/23 3:f155f0d9:::rbd_data.1182c9370f88.000000000000000f:head v 28'60, mlcod=28'57)", 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:57.726369+0000", 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.7341852019999999, 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031828770000000002, 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726369+0000", 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726369+0000", 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726370+0000", 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7300000000000001e-07 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726375+0000", 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0980000000000001e-06 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726640+0000", 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026564399999999999 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726648+0000", 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.323e-06 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726749+0000", 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101034 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726771+0000", 2024-09-14T07:11:59.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1772000000000001e-05 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.729482+0000", 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027116660000000002 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.729552+0000", 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9867e-05 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:991 3.11 e28/23 3:88549360:::rbd_header.11822ba09815:head v 28'15, mlcod=28'13)", 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.3211496979999999, 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032514559999999998, 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139418+0000", 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2762000000000001e-05 2024-09-14T07:11:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139427+0000", 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8179999999999993e-06 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139431+0000", 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6099999999999999e-06 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139476+0000", 2024-09-14T07:11:59.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4838e-05 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139497+0000", 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0791000000000001e-05 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.142627+0000", 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003130037 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.142656+0000", 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8999000000000001e-05 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1019 3.11 e28/23 3:88549360:::rbd_header.11822ba09815:head v 28'19, mlcod=28'17)", 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.174622+0000", 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.285932598, 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023573639999999998, 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.483 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174622+0000", 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174622+0000", 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174622+0000", 2024-09-14T07:11:59.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1699999999999998e-07 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174626+0000", 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.704e-06 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174635+0000", 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7169999999999997e-06 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174640+0000", 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0259999999999998e-06 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174685+0000", 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5509000000000001e-05 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.174705+0000", 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9457999999999999e-05 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.176948+0000", 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022430990000000001 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.176979+0000", 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1334000000000002e-05 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1704 3.1d e29/23 3:bab929bf:::rbd_data.1182823d0fd0.0000000000000041:head v 29'7, mlcod=28'4)", 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.934704+0000", 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.52585083200000005, 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019568229999999999, 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934704+0000", 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934704+0000", 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934704+0000", 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3399999999999998e-07 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934722+0000", 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7405e-05 2024-09-14T07:11:59.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934732+0000", 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9899999999999992e-06 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934736+0000", 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6249999999999998e-06 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934788+0000", 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1415999999999997e-05 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.934810+0000", 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1708999999999998e-05 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.936631+0000", 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001821565 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.936660+0000", 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9278999999999999e-05 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1747 3.a e29/23 3:50ad8e37:::rbd_data.1182823d0fd0.0000000000000011:head v 29'8, mlcod=29'6)", 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.968857+0000", 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.49169752700000002, 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001881158, 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.492 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968857+0000", 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968857+0000", 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968858+0000", 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6599999999999995e-07 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968865+0000", 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2269999999999996e-06 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968879+0000", 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4236000000000001e-05 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968887+0000", 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6790000000000005e-06 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968947+0000", 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9880000000000003e-05 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968967+0000", 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.003e-05 2024-09-14T07:11:59.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.970699+0000", 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001732241 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.970738+0000", 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099e-05 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1750 3.11 e29/23 3:8e6097e5:::rbd_data.1182823d0fd0.0000000000000028:head v 29'35, mlcod=29'33)", 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.968942+0000", 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.49161227600000001, 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044981520000000001, 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968942+0000", 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968942+0000", 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968943+0000", 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8899999999999999e-07 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968947+0000", 2024-09-14T07:11:59.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8310000000000003e-06 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968955+0000", 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0369999999999995e-06 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968960+0000", 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3229999999999997e-06 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969027+0000", 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6892999999999998e-05 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969045+0000", 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8609000000000001e-05 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973382+0000", 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043364340000000001 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973440+0000", 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8436000000000001e-05 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1746 3.1b e29/23 3:db8f39e2:::rbd_data.1182823d0fd0.0000000000000010:head v 29'12, mlcod=29'10)", 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.969006+0000", 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.49154833799999997, 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044282389999999996, 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.501 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969006+0000", 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969006+0000", 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969007+0000", 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7700000000000004e-07 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969013+0000", 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5490000000000003e-06 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969027+0000", 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3844e-05 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969034+0000", 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1199999999999996e-06 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969093+0000", 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8313000000000002e-05 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969111+0000", 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8573999999999999e-05 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973387+0000", 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042762499999999997 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973434+0000", 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6811999999999998e-05 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1752 3.1d e29/23 3:bab929bf:::rbd_data.1182823d0fd0.0000000000000041:head v 29'8, mlcod=29'6)", 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.969421+0000", 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.491133337, 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040204480000000003, 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969421+0000", 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969421+0000", 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969422+0000", 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3799999999999997e-07 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969429+0000", 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969441+0000", 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2036e-05 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969447+0000", 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5039999999999999e-06 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969495+0000", 2024-09-14T07:11:59.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7624999999999999e-05 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969514+0000", 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9341e-05 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973400+0000", 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038858569999999999 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973442+0000", 2024-09-14T07:11:59.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1294000000000001e-05 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1753 3.a e29/23 3:54733f3e:::rbd_data.1182823d0fd0.000000000000004e:head v 29'9, mlcod=29'6)", 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.969509+0000", 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.49104540200000002, 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039655510000000003, 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969509+0000", 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969509+0000", 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969510+0000", 2024-09-14T07:11:59.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3099999999999997e-07 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969515+0000", 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3399999999999997e-06 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969525+0000", 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0370999999999999e-05 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969532+0000", 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3249999999999996e-06 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969586+0000", 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4653e-05 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969603+0000", 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6266999999999999e-05 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973440+0000", 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038368629999999998 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973475+0000", 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5000999999999999e-05 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2006 3.3 3:c419be08:::rbd_data.1182823d0fd0.000000000000004b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.514 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.102234+0000", 2024-09-14T07:11:59.515 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.35832022000000002, 2024-09-14T07:11:59.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021965679999999999, 2024-09-14T07:11:59.516 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.516 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.516 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2006 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102234+0000", 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102234+0000", 2024-09-14T07:11:59.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102236+0000", 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8500000000000001e-06 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102242+0000", 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.643e-06 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102255+0000", 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3774999999999999e-05 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102263+0000", 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1790000000000002e-06 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102312+0000", 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9081e-05 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102384+0000", 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2725999999999995e-05 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102503+0000", 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000118544 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.102976+0000", 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047266499999999999 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.104333+0000", 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013573719999999999 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.104385+0000", 2024-09-14T07:11:59.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2193e-05 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.104431+0000", 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5540000000000001e-05 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2124 3.1a 3:5e82dd18:::rbd_data.1182823d0fd0.0000000000000049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.241206+0000", 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.21934838700000001, 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003891294, 2024-09-14T07:11:59.522 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2124 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241206+0000", 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241206+0000", 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241207+0000", 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.364e-06 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241212+0000", 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0980000000000001e-06 2024-09-14T07:11:59.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241225+0000", 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2965999999999999e-05 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241231+0000", 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0009999999999998e-06 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241299+0000", 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7130000000000003e-05 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241402+0000", 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010309199999999999 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241534+0000", 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013255400000000001 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.242061+0000", 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052692199999999998 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.245024+0000", 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029626040000000002 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.245055+0000", 2024-09-14T07:11:59.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1741e-05 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.245097+0000", 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1822e-05 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2164 3.1a 3:59f81f62:::rbd_data.1182823d0fd0.0000000000000031:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:11:59.528 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.15780461400000001, 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013431442, 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2164 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302751+0000", 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.003e-06 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302755+0000", 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059999999999996e-06 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302767+0000", 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1204e-05 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302772+0000", 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7270000000000004e-06 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302816+0000", 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3322999999999998e-05 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302909+0000", 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3614000000000002e-05 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.304973+0000", 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020640609999999998 2024-09-14T07:11:59.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316056+0000", 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011082992 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316073+0000", 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6512e-05 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316128+0000", 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.469e-05 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316181+0000", 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3709999999999999e-05 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:2164 3.1a e29/23 ondisk, result = 0)", 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.311489+0000", 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.149065638, 2024-09-14T07:11:59.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045762820000000001, 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311489+0000", 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311489+0000", 2024-09-14T07:11:59.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311490+0000", 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4e-07 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311494+0000", 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5700000000000003e-06 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311508+0000", 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3815000000000001e-05 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311517+0000", 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5539999999999998e-06 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316038+0000", 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045217679999999998 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316049+0000", 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499000000000001e-05 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316065+0000", 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6135999999999999e-05 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.538 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2213 3.1a 3:59f81f62:::rbd_data.1182823d0fd0.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391592+0000", 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.068962661999999994, 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0079048780000000006, 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2213 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391592+0000", 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391592+0000", 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391594+0000", 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.984e-06 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391601+0000", 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4420000000000001e-06 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391619+0000", 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.802e-05 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391629+0000", 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9340000000000001e-06 2024-09-14T07:11:59.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391701+0000", 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1637000000000005e-05 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391791+0000", 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9846999999999995e-05 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391918+0000", 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012690999999999999 2024-09-14T07:11:59.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392684+0000", 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076658100000000001 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399427+0000", 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067427600000000004 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399468+0000", 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1480999999999998e-05 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399497+0000", 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8282000000000001e-05 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2216 3.13 e29/23 3:cb9ca5de:::rbd_data.1182823d0fd0.000000000000005d:head v 29'14, mlcod=29'12)", 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391915+0000", 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.068639504000000004, 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059801890000000003, 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391915+0000", 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391915+0000", 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391916+0000", 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391924+0000", 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5549999999999997e-06 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391935+0000", 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1953999999999999e-05 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391942+0000", 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.024e-06 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392009+0000", 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6353999999999995e-05 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392029+0000", 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9896000000000001e-05 2024-09-14T07:11:59.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.397848+0000", 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058196439999999997 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.397895+0000", 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6687000000000002e-05 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2215 3.a e29/23 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head v 29'12, mlcod=29'10)", 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.392028+0000", 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.068526373000000002, 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074941870000000002, 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392028+0000", 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392028+0000", 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392029+0000", 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5700000000000002e-07 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392033+0000", 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392053+0000", 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9595000000000001e-05 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392061+0000", 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.456e-06 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392134+0000", 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2822000000000002e-05 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392152+0000", 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8034999999999999e-05 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399501+0000", 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073484190000000001 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399522+0000", 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1613000000000001e-05 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.552 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2245 3.1a 3:5f792b6e:::rbd_data.1182823d0fd0.000000000000001d:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.433146+0000", 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.027407982000000001, 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087375230000000005, 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:11:59.553 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2245 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433146+0000", 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433146+0000", 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433148+0000", 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433155+0000", 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4599999999999997e-06 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433171+0000", 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5321000000000001e-05 2024-09-14T07:11:59.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433178+0000", 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0169999999999999e-06 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433231+0000", 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2979000000000002e-05 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433332+0000", 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100979 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.434522+0000", 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001189816 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441729+0000", 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007207621 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441771+0000", 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2274999999999998e-05 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441828+0000", 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6249000000000003e-05 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441884+0000", 2024-09-14T07:11:59.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6218999999999998e-05 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:2245 3.1a e29/23 ondisk, result = 0)", 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.021778697999999999, 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031245349999999999, 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:11:59.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1999999999999999e-07 2024-09-14T07:11:59.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438780+0000", 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1269999999999996e-06 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438790+0000", 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1120000000000002e-06 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438794+0000", 2024-09-14T07:11:59.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441755+0000", 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029602890000000001 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441764+0000", 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5300000000000002e-06 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:11:59.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441900+0000", 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013599700000000001 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:11:59.563 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:59.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:11:59.566 INFO:teuthology.orchestra.run.smithi071.stdout:446 read 0x14582c thru 0x152721 (0xcef6 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:447 read 0x8315d thru 0x92580 (0xf424 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:448 writesame 0xb8e60a thru 0xb963fc data_size 0x1(0x7df3 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:449 read 0x1e6b06b thru 0x1e7365e (0x85f4 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:450 trunc from 0x1e89096 to 0x1c307f6 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:451 read 0x52b748 thru 0x53044c (0x4d05 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:453 write 0xaf06b29 thru 0xaf0ef6e (0x8446 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:454 write 0x64eeced thru 0x64f094d (0x1c61 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:455 write 0x1f5ec1 thru 0x20033d (0xa47d bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:457 writesame 0x8d4a0c5 thru 0x8d4fd48 data_size 0x3e(0x5c84 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:459 write 0x47d85bb thru 0x47de330 (0x5d76 bytes) 2024-09-14T07:11:59.567 INFO:teuthology.orchestra.run.smithi071.stdout:462 writesame 0x10f5513 thru 0x1103303 data_size 0x3b(0xddf1 bytes) 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:465 punch from 0x7dcdbc2 to 0x7dd4ea2, (0x72e0 bytes) 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:466 writesame 0xcf3c5c9 thru 0xcf435d1 data_size 0x1d(0x7009 bytes) 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:467 trunc from 0xcf435d2 to 0x59d7379 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:468 writesame 0x832a17f thru 0x832e426 data_size 0x4f(0x42a8 bytes) 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:470 write 0xc0a84 thru 0xc4685 (0x3c02 bytes) 2024-09-14T07:11:59.568 INFO:teuthology.orchestra.run.smithi071.stdout:471 write 0xa61a42e thru 0xa62056e (0x6141 bytes) 2024-09-14T07:11:59.568 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:11:59.563+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:11:59.569 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.569 INFO:teuthology.orchestra.run.smithi071.stdout:474 write 0x7d4dacf thru 0x7d557b8 (0x7cea bytes) 2024-09-14T07:11:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:475 read 0x21fa46f thru 0x2208080 (0xdc12 bytes) 2024-09-14T07:11:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:477 punch from 0x9974ecd to 0x997f0f8, (0xa22b bytes) 2024-09-14T07:11:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:478 read 0x3823a3b thru 0x3827b5e (0x4124 bytes) 2024-09-14T07:11:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:479 write 0x3d8e82e thru 0x3d93b2c (0x52ff bytes) 2024-09-14T07:11:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:480 read 0x36780fc thru 0x3686f00 (0xee05 bytes) 2024-09-14T07:11:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:482 write 0x8dbd39e thru 0x8dc2729 (0x538c bytes) 2024-09-14T07:11:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:483 writesame 0x10ff629 thru 0x11007a1 data_size 0x15(0x1179 bytes) 2024-09-14T07:11:59.590 INFO:teuthology.orchestra.run.smithi071.stdout:484 write 0x1d2da83 thru 0x1d33032 (0x55b0 bytes) 2024-09-14T07:11:59.597 INFO:teuthology.orchestra.run.smithi071.stdout:485 writesame 0x24b3bcb thru 0x24c3a5c data_size 0xbe(0xfe92 bytes) 2024-09-14T07:11:59.600 INFO:teuthology.orchestra.run.smithi071.stdout:486 writesame 0x5f4cd77 thru 0x5f5caca data_size 0x3e(0xfd54 bytes) 2024-09-14T07:11:59.604 INFO:teuthology.orchestra.run.smithi071.stdout:487 punch from 0x3217563 to 0x321c5c7, (0x5064 bytes) 2024-09-14T07:11:59.605 INFO:teuthology.orchestra.run.smithi071.stdout:488 trunc from 0xa62056f to 0xb54100e 2024-09-14T07:11:59.610 INFO:teuthology.orchestra.run.smithi071.stdout:489 write 0x3147b8f thru 0x314ec52 (0x70c4 bytes) 2024-09-14T07:11:59.613 INFO:teuthology.orchestra.run.smithi071.stdout:490 read 0x93941cf thru 0x939d79a (0x95cc bytes) 2024-09-14T07:11:59.613 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.620 INFO:teuthology.orchestra.run.smithi071.stdout:492 trunc from 0xb54100e to 0x5016f14 2024-09-14T07:11:59.649 INFO:teuthology.orchestra.run.smithi071.stdout:494 write 0xac5a97f thru 0xac6141a (0x6a9c bytes) 2024-09-14T07:11:59.655 INFO:teuthology.orchestra.run.smithi071.stdout:495 writesame 0x18955a thru 0x18dea7 data_size 0xb(0x494e bytes) 2024-09-14T07:11:59.657 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.662 INFO:teuthology.orchestra.run.smithi071.stdout:497 writesame 0xb173d3c thru 0xb1795af data_size 0x12(0x5874 bytes) 2024-09-14T07:11:59.662 INFO:teuthology.orchestra.run.smithi071.stdout:499 writesame 0x7a06194 thru 0x7a0677f data_size 0x2(0x5ec bytes) 2024-09-14T07:11:59.665 INFO:teuthology.orchestra.run.smithi071.stdout:501 read 0xa2210d3 thru 0xa22901d (0x7f4b bytes) 2024-09-14T07:11:59.665 INFO:teuthology.orchestra.run.smithi071.stdout:502 read 0x67fa5ed thru 0x6807d24 (0xd738 bytes) 2024-09-14T07:11:59.665 INFO:teuthology.orchestra.run.smithi071.stdout:504 write 0x7d7af62 thru 0x7d7dcde (0x2d7d bytes) 2024-09-14T07:11:59.665 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:11:59.664+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:11:59.674 INFO:teuthology.orchestra.run.smithi071.stdout:505 read 0x6fa52ad thru 0x6fa8d09 (0x3a5d bytes) 2024-09-14T07:11:59.674 INFO:teuthology.orchestra.run.smithi071.stdout:506 read 0xaa05920 thru 0xaa10b9f (0xb280 bytes) 2024-09-14T07:11:59.676 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:11:59.679 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:59.679 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:59.679 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:11:59.679 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:59.680 INFO:teuthology.orchestra.run.smithi071.stdout:507 trunc from 0xb1795b0 to 0x69d66ea 2024-09-14T07:11:59.689 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:11:59.694 INFO:teuthology.orchestra.run.smithi071.stdout:508 read 0x65ed40c thru 0x65f51e1 (0x7dd6 bytes) 2024-09-14T07:11:59.694 INFO:teuthology.orchestra.run.smithi071.stdout:509 read 0x24c3254 thru 0x24cc11c (0x8ec9 bytes) 2024-09-14T07:11:59.700 INFO:teuthology.orchestra.run.smithi071.stdout:510 write 0x763f270 thru 0x764805a (0x8deb bytes) 2024-09-14T07:11:59.706 INFO:teuthology.orchestra.run.smithi071.stdout:511 punch from 0x4688660 to 0x46902f5, (0x7c95 bytes) 2024-09-14T07:11:59.711 INFO:teuthology.orchestra.run.smithi071.stdout:512 write 0x7b2d962 thru 0x7b35421 (0x7ac0 bytes) 2024-09-14T07:11:59.716 INFO:teuthology.orchestra.run.smithi071.stdout:513 punch from 0x172326 to 0x181ac1, (0xf79b bytes) 2024-09-14T07:11:59.725 INFO:teuthology.orchestra.run.smithi071.stdout:514 write 0xb32a344 thru 0xb333a3f (0x96fc bytes) 2024-09-14T07:11:59.729 INFO:teuthology.orchestra.run.smithi071.stdout:515 read 0x409f5b2 thru 0x40a65c3 (0x7012 bytes) 2024-09-14T07:11:59.734 INFO:teuthology.orchestra.run.smithi071.stdout:516 write 0xb9de9c4 thru 0xb9ee148 (0xf785 bytes) 2024-09-14T07:11:59.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:11:59.738 INFO:teuthology.orchestra.run.smithi071.stdout:517 write 0xb98d84b thru 0xb98da92 (0x248 bytes) 2024-09-14T07:11:59.745 INFO:teuthology.orchestra.run.smithi071.stdout:520 trunc from 0xb9ee149 to 0x6f0b071 2024-09-14T07:11:59.758 INFO:teuthology.orchestra.run.smithi071.stdout:521 read 0x2cf1795 thru 0x2d0059e (0xee0a bytes) 2024-09-14T07:11:59.758 INFO:teuthology.orchestra.run.smithi071.stdout:523 read 0x55b39a3 thru 0x55c112b (0xd789 bytes) 2024-09-14T07:11:59.758 INFO:teuthology.orchestra.run.smithi071.stdout:524 read 0x2b86a3d thru 0x2b8ea43 (0x8007 bytes) 2024-09-14T07:11:59.764 INFO:teuthology.orchestra.run.smithi071.stdout:525 trunc from 0x6f0b071 to 0x17a6305 2024-09-14T07:11:59.773 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:59.772+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:59.790 INFO:teuthology.orchestra.run.smithi071.stdout:526 trunc from 0x17a6305 to 0xbbd2ea0 2024-09-14T07:11:59.795 INFO:teuthology.orchestra.run.smithi071.stdout:527 read 0x83eb7fa thru 0x83ececf (0x16d6 bytes) 2024-09-14T07:11:59.796 INFO:teuthology.orchestra.run.smithi071.stdout:528 write 0xa548dd9 thru 0xa555dc6 (0xcfee bytes) 2024-09-14T07:11:59.799 INFO:teuthology.orchestra.run.smithi071.stdout:529 punch from 0x65c8976 to 0x65c9b0b, (0x1195 bytes) 2024-09-14T07:11:59.799 INFO:teuthology.orchestra.run.smithi071.stdout:530 writesame 0x8c65537 thru 0x8c6a870 data_size 0x6(0x533a bytes) 2024-09-14T07:11:59.804 INFO:teuthology.orchestra.run.smithi071.stdout:531 read 0x9c6e27f thru 0x9c7a84c (0xc5ce bytes) 2024-09-14T07:11:59.804 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.804 INFO:teuthology.orchestra.run.smithi071.stdout:534 read 0xb705ce1 thru 0xb70b599 (0x58b9 bytes) 2024-09-14T07:11:59.804 INFO:teuthology.orchestra.run.smithi071.stdout:536 read 0xa1a8b25 thru 0xa1b6775 (0xdc51 bytes) 2024-09-14T07:11:59.804 INFO:teuthology.orchestra.run.smithi071.stdout:538 read 0x53dcaad thru 0x53ddb17 (0x106b bytes) 2024-09-14T07:11:59.804 INFO:teuthology.orchestra.run.smithi071.stdout:540 punch from 0x21b9678 to 0x21c09cd, (0x7355 bytes) 2024-09-14T07:11:59.816 INFO:teuthology.orchestra.run.smithi071.stdout:541 trunc from 0xbbd2ea0 to 0x1781c17 2024-09-14T07:11:59.836 INFO:teuthology.orchestra.run.smithi071.stdout:544 trunc from 0x1781c17 to 0x943c0d4 2024-09-14T07:11:59.837 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:11:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:11:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:11:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:11:59.837 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:11:59.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:11:59.848 INFO:teuthology.orchestra.run.smithi071.stdout:546 trunc from 0x943c0d4 to 0x3c4c371 2024-09-14T07:11:59.853 INFO:teuthology.orchestra.run.smithi071.stdout:547 writesame 0x1d85b74 thru 0x1d87383 data_size 0x38(0x1810 bytes) 2024-09-14T07:11:59.873 INFO:teuthology.orchestra.run.smithi071.stdout:548 write 0xc816c56 thru 0xc817ece (0x1279 bytes) 2024-09-14T07:11:59.875 INFO:teuthology.orchestra.run.smithi071.stdout:549 writesame 0x8b093fd thru 0x8b0df60 data_size 0x32(0x4b64 bytes) 2024-09-14T07:11:59.878 INFO:teuthology.orchestra.run.smithi071.stdout:551 write 0x7babf39 thru 0x7bb8b1c (0xcbe4 bytes) 2024-09-14T07:11:59.887 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:11:59.886+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:11:59.887 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:11:59.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:11:59.888 INFO:teuthology.orchestra.run.smithi071.stdout:552 write 0xca1abac thru 0xca231dd (0x8632 bytes) 2024-09-14T07:11:59.895 INFO:teuthology.orchestra.run.smithi071.stdout:554 read 0x83a8543 thru 0x83aca7a (0x4538 bytes) 2024-09-14T07:11:59.895 INFO:teuthology.orchestra.run.smithi071.stdout:556 read 0x2344112 thru 0x234b07d (0x6f6c bytes) 2024-09-14T07:11:59.895 INFO:teuthology.orchestra.run.smithi071.stdout:557 read 0x1f621fc thru 0x1f7119b (0xefa0 bytes) 2024-09-14T07:11:59.896 INFO:teuthology.orchestra.run.smithi071.stdout:558 read 0x8b11f34 thru 0x8b1a623 (0x86f0 bytes) 2024-09-14T07:11:59.896 INFO:teuthology.orchestra.run.smithi071.stdout:560 read 0x422c285 thru 0x4232958 (0x66d4 bytes) 2024-09-14T07:11:59.896 INFO:teuthology.orchestra.run.smithi071.stdout:562 write 0xc67ede2 thru 0xc68e75c (0xf97b bytes) 2024-09-14T07:11:59.903 INFO:teuthology.orchestra.run.smithi071.stdout:563 writesame 0xa8f0b thru 0xb6d81 data_size 0x1(0xde77 bytes) 2024-09-14T07:11:59.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:11:59.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:11:59.916 INFO:teuthology.orchestra.run.smithi071.stdout:564 punch from 0x8b06302 to 0x8b0b968, (0x5666 bytes) 2024-09-14T07:11:59.916 INFO:teuthology.orchestra.run.smithi071.stdout:565 read 0xaf4c11 thru 0xaf963e (0x4a2e bytes) 2024-09-14T07:11:59.916 INFO:teuthology.orchestra.run.smithi071.stdout:566 punch from 0x5da5f09 to 0x5db541a, (0xf511 bytes) 2024-09-14T07:11:59.917 INFO:teuthology.orchestra.run.smithi071.stdout:568 trunc from 0xca231de to 0xb82c2cb 2024-09-14T07:11:59.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:11:59.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:11:59.931 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.931 INFO:teuthology.orchestra.run.smithi071.stdout:573 writesame 0x6911c85 thru 0x691a8cd data_size 0x1(0x8c49 bytes) 2024-09-14T07:11:59.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:11:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:11:59.952 INFO:teuthology.orchestra.run.smithi071.stdout:575 write 0x3fa304 thru 0x409f5a (0xfc57 bytes) 2024-09-14T07:11:59.954 INFO:teuthology.orchestra.run.smithi071.stdout:577 write 0x3fa4d1d thru 0x3fac366 (0x764a bytes) 2024-09-14T07:11:59.957 INFO:teuthology.orchestra.run.smithi071.stdout:578 write 0x2828449 thru 0x282e7cd (0x6385 bytes) 2024-09-14T07:11:59.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:11:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:11:59.967 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:11:59.967+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:11:59.969 INFO:teuthology.orchestra.run.smithi071.stdout:579 write 0xed01651 thru 0xed0fdf6 (0xe7a6 bytes) 2024-09-14T07:11:59.974 INFO:teuthology.orchestra.run.smithi071.stdout:581 write 0x569363a thru 0x569885b (0x5222 bytes) 2024-09-14T07:11:59.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:11:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:11:59.978 INFO:teuthology.orchestra.run.smithi071.stdout:582 read 0xd2b6957 thru 0xd2c677a (0xfe24 bytes) 2024-09-14T07:11:59.978 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:11:59.978 INFO:teuthology.orchestra.run.smithi071.stdout:587 read 0x1b0e26e thru 0x1b1125b (0x2fee bytes) 2024-09-14T07:11:59.978 INFO:teuthology.orchestra.run.smithi071.stdout:588 read 0x87a724a thru 0x87a808e (0xe45 bytes) 2024-09-14T07:11:59.992 INFO:teuthology.orchestra.run.smithi071.stdout:589 trunc from 0xed0fdf7 to 0x2c8ae79 2024-09-14T07:11:59.995 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:11:59.995 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:11:59.996 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:11:59.996 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:00.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:00.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:00.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:00.014 INFO:teuthology.orchestra.run.smithi071.stdout:590 write 0x5cec7be thru 0x5cf48e8 (0x812b bytes) 2024-09-14T07:12:00.021 INFO:teuthology.orchestra.run.smithi071.stdout:593 read 0x3bb1d00 thru 0x3bb21eb (0x4ec bytes) 2024-09-14T07:12:00.021 INFO:teuthology.orchestra.run.smithi071.stdout:594 punch from 0x590d533 to 0x590e424, (0xef1 bytes) 2024-09-14T07:12:00.021 INFO:teuthology.orchestra.run.smithi071.stdout:595 read 0x5bc8754 thru 0x5bcb78d (0x303a bytes) 2024-09-14T07:12:00.021 INFO:teuthology.orchestra.run.smithi071.stdout:596 read 0x3521d4a thru 0x3530712 (0xe9c9 bytes) 2024-09-14T07:12:00.031 INFO:teuthology.orchestra.run.smithi071.stdout:600 write 0xa322cff thru 0xa322f24 (0x226 bytes) 2024-09-14T07:12:00.035 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:00.035 INFO:teuthology.orchestra.run.smithi071.stdout:606 read 0x6e71cd2 thru 0x6e723fa (0x729 bytes) 2024-09-14T07:12:00.035 INFO:teuthology.orchestra.run.smithi071.stdout:607 punch from 0x9cd6a4b to 0x9cd88cb, (0x1e80 bytes) 2024-09-14T07:12:00.036 INFO:teuthology.orchestra.run.smithi071.stdout:608 read 0x324cd7a thru 0x3255c5a (0x8ee1 bytes) 2024-09-14T07:12:00.041 INFO:teuthology.orchestra.run.smithi071.stdout:609 trunc from 0xa322f25 to 0x4bccf25 2024-09-14T07:12:00.058 INFO:teuthology.orchestra.run.smithi071.stdout:612 punch from 0x4b31be7 to 0x4b3847c, (0x6895 bytes) 2024-09-14T07:12:00.058 INFO:teuthology.orchestra.run.smithi071.stdout:613 clone 4 order 19 su 4096 sc 13 2024-09-14T07:12:00.089 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:00.088+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:00.147 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.147 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:00.197 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:12:00.196+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:12:00.270 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:00.269+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:00.298 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.298 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:00.371 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:00.370+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:00.409 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.409 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:00.472 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:00.472+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:00.520 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.520 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.529 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:00.613 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:00.612+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:00.674 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.675 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.675 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:00.674+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:00.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:00.775 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:00.775+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:00.823 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-14T07:12:00.829 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.829 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:00.882 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:00.881+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:00.894 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:00.894 INFO:teuthology.orchestra.run.smithi071.stdout:615 read 0x4b071cf thru 0x4b0f889 (0x86bb bytes) 2024-09-14T07:12:00.905 INFO:teuthology.orchestra.run.smithi071.stdout:616 write 0x62fa899 thru 0x6308fe6 (0xe74e bytes) 2024-09-14T07:12:00.929 INFO:teuthology.orchestra.run.smithi071.stdout:617 write 0x75b53d8 thru 0x75b5e9a (0xac3 bytes) 2024-09-14T07:12:00.932 INFO:teuthology.orchestra.run.smithi071.stdout:618 punch from 0x5af9add to 0x5afdd21, (0x4244 bytes) 2024-09-14T07:12:00.946 INFO:teuthology.orchestra.run.smithi071.stdout:622 write 0xdc7d1a4 thru 0xdc8a6a5 (0xd502 bytes) 2024-09-14T07:12:00.949 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:00.949 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:00.960 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:00.978 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:12:00.978+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:12:01.080 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:01.079+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:01.103 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:01.103 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:01.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:01.161 INFO:teuthology.orchestra.run.smithi071.stdout:624 trunc from 0xdc8a6a6 to 0xd6cf7bc 2024-09-14T07:12:01.171 INFO:teuthology.orchestra.run.smithi071.stdout:625 writesame 0x12448d7 thru 0x12477a2 data_size 0xa(0x2ecc bytes) 2024-09-14T07:12:01.181 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:01.180+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:01.222 INFO:teuthology.orchestra.run.smithi071.stdout:626 trunc from 0xd6cf7bc to 0x95fe252 2024-09-14T07:12:01.246 INFO:teuthology.orchestra.run.smithi071.stdout:627 writesame 0xd53ffbc thru 0xd54acd1 data_size 0x69(0xad16 bytes) 2024-09-14T07:12:01.246 INFO:teuthology.orchestra.run.smithi071.stdout:628 writesame 0x62ab727 thru 0x62b1814 data_size 0x13(0x60ee bytes) 2024-09-14T07:12:01.248 INFO:teuthology.orchestra.run.smithi071.stdout:629 punch from 0xac4cca1 to 0xac57ba8, (0xaf07 bytes) 2024-09-14T07:12:01.249 INFO:teuthology.orchestra.run.smithi071.stdout:630 write 0xc252c37 thru 0xc2547c5 (0x1b8f bytes) 2024-09-14T07:12:01.253 INFO:teuthology.orchestra.run.smithi071.stdout:631 punch from 0x5febe6c to 0x5ff02dd, (0x4471 bytes) 2024-09-14T07:12:01.253 INFO:teuthology.orchestra.run.smithi071.stdout:632 read 0x5f9f4a0 thru 0x5fa570b (0x626c bytes) 2024-09-14T07:12:01.253 INFO:teuthology.orchestra.run.smithi071.stdout:633 write 0x212e792 thru 0x21360d9 (0x7948 bytes) 2024-09-14T07:12:01.268 INFO:teuthology.orchestra.run.smithi071.stdout:635 read 0xe8246 thru 0xf1c24 (0x99df bytes) 2024-09-14T07:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:01.282 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:01.281+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout:636 trunc from 0xd54acd2 to 0x1e9f5e1 2024-09-14T07:12:01.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:01.382 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:01.381+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:637 write 0x60e9a4d thru 0x60f3729 (0x9cdd bytes) 2024-09-14T07:12:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:638 write 0x12b804f thru 0x12c482a (0xc7dc bytes) 2024-09-14T07:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:01.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:01.483 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:01.482+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:01.512 INFO:teuthology.orchestra.run.smithi071.stdout:639 write 0x7aa2d5 thru 0x7b6b9b (0xc8c7 bytes) 2024-09-14T07:12:01.584 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:12:01.583+0000 7f373b5c8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33338) UID: 0 2024-09-14T07:12:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:640 write 0xa2b196a thru 0xa2b708f (0x5726 bytes) 2024-09-14T07:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:641 punch from 0x3298ed9 to 0x32a8aa0, (0xfbc7 bytes) 2024-09-14T07:12:01.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:642 trunc from 0xa2b7090 to 0x4f6622b 2024-09-14T07:12:01.667 INFO:teuthology.orchestra.run.smithi071.stdout:643 read 0x339a02e thru 0x33a3166 (0x9139 bytes) 2024-09-14T07:12:01.667 INFO:teuthology.orchestra.run.smithi071.stdout:644 read 0x1d1f18c thru 0x1d29e9d (0xad12 bytes) 2024-09-14T07:12:01.669 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.669 INFO:teuthology.orchestra.run.smithi071.stdout:646 read 0x301d5f6 thru 0x3021905 (0x4310 bytes) 2024-09-14T07:12:01.670 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.681 INFO:teuthology.orchestra.run.smithi071.stdout:650 write 0xa93457d thru 0xa939555 (0x4fd9 bytes) 2024-09-14T07:12:01.684 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:01.683+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:01.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:12:01.695 INFO:teuthology.orchestra.run.smithi071.stdout:651 write 0x50f70ba thru 0x50fa3fd (0x3344 bytes) 2024-09-14T07:12:01.704 INFO:teuthology.orchestra.run.smithi071.stdout:652 write 0x9e6f068 thru 0x9e73972 (0x490b bytes) 2024-09-14T07:12:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:654 punch from 0x813c254 to 0x813f54f, (0x32fb bytes) 2024-09-14T07:12:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:658 read 0x6ef73b5 thru 0x6f06aa9 (0xf6f5 bytes) 2024-09-14T07:12:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:659 punch from 0x4ce6024 to 0x4cf38fc, (0xd8d8 bytes) 2024-09-14T07:12:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:660 write 0x9d38720 thru 0x9d475b8 (0xee99 bytes) 2024-09-14T07:12:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:661 read 0x4627a49 thru 0x462c4d3 (0x4a8b bytes) 2024-09-14T07:12:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:662 trunc from 0xa939556 to 0xc406d5e 2024-09-14T07:12:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:663 read 0x38e4ac thru 0x39b51f (0xd074 bytes) 2024-09-14T07:12:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:665 write 0x1d9583a thru 0x1d9a995 (0x515c bytes) 2024-09-14T07:12:01.746 INFO:teuthology.orchestra.run.smithi071.stdout:667 writesame 0x47a5c31 thru 0x47a8e27 data_size 0x1(0x31f7 bytes) 2024-09-14T07:12:01.754 INFO:teuthology.orchestra.run.smithi071.stdout:668 read 0xbd41fcf thru 0xbd452ee (0x3320 bytes) 2024-09-14T07:12:01.759 INFO:teuthology.orchestra.run.smithi071.stdout:669 write 0xcb531bc thru 0xcb6149f (0xe2e4 bytes) 2024-09-14T07:12:01.769 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:01.769 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:01.777 INFO:teuthology.orchestra.run.smithi071.stdout:671 write 0x9f9e687 thru 0x9fab0ea (0xca64 bytes) 2024-09-14T07:12:01.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:01.785 INFO:teuthology.orchestra.run.smithi071.stdout:673 writesame 0x3d8f12f thru 0x3d8fd83 data_size 0xb(0xc55 bytes) 2024-09-14T07:12:01.786 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:01.785+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:01.788 INFO:teuthology.orchestra.run.smithi071.stdout:674 punch from 0x5683b17 to 0x5686674, (0x2b5d bytes) 2024-09-14T07:12:01.801 INFO:teuthology.orchestra.run.smithi071.stdout:676 trunc from 0xcb614a0 to 0x221c6b0 2024-09-14T07:12:01.834 INFO:teuthology.orchestra.run.smithi071.stdout:677 trunc from 0x221c6b0 to 0x1951ecd 2024-09-14T07:12:01.876 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.885 INFO:teuthology.orchestra.run.smithi071.stdout:680 write 0x4bd639f thru 0x4be0a36 (0xa698 bytes) 2024-09-14T07:12:01.886 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:01.885+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:01.896 INFO:teuthology.orchestra.run.smithi071.stdout:682 read 0x39f05bf thru 0x39fd41d (0xce5f bytes) 2024-09-14T07:12:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:683 writesame 0xbe9334a thru 0xbe973ae data_size 0x23(0x4065 bytes) 2024-09-14T07:12:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:684 read 0xb021f6a thru 0xb024b46 (0x2bdd bytes) 2024-09-14T07:12:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:685 read 0x5038f0c thru 0x503a73e (0x1833 bytes) 2024-09-14T07:12:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:688 write 0x3d94743 thru 0x3d99d30 (0x55ee bytes) 2024-09-14T07:12:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:01.912 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:01.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:01.922 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.923 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.923 INFO:teuthology.orchestra.run.smithi071.stdout:692 punch from 0xc33dfd to 0xc35085, (0x1288 bytes) 2024-09-14T07:12:01.923 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:01.926 INFO:teuthology.orchestra.run.smithi071.stdout:694 trunc from 0xbe973af to 0x88bdc6f 2024-09-14T07:12:01.939 INFO:teuthology.orchestra.run.smithi071.stdout:695 writesame 0xa7cec5e thru 0xa7dd2cf data_size 0xd(0xe672 bytes) 2024-09-14T07:12:01.946 INFO:teuthology.orchestra.run.smithi071.stdout:696 write 0xb615ddb thru 0xb61ca4f (0x6c75 bytes) 2024-09-14T07:12:01.973 INFO:teuthology.orchestra.run.smithi071.stdout:697 trunc from 0xb61ca50 to 0x1051dca 2024-09-14T07:12:01.987 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:01.986+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:02.017 INFO:teuthology.orchestra.run.smithi071.stdout:699 write 0x6e4442f thru 0x6e50305 (0xbed7 bytes) 2024-09-14T07:12:02.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:02.033 INFO:teuthology.orchestra.run.smithi071.stdout:700 punch from 0x57ca317 to 0x57d09ff, (0x66e8 bytes) 2024-09-14T07:12:02.039 INFO:teuthology.orchestra.run.smithi071.stdout:701 trunc from 0x6e50306 to 0xb7533e7 2024-09-14T07:12:02.045 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:02.045 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:02.045 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:704 write 0x258a915 thru 0x2591a76 (0x7162 bytes) 2024-09-14T07:12:02.054 INFO:teuthology.orchestra.run.smithi071.stdout:705 write 0x745a92a thru 0x7460c94 (0x636b bytes) 2024-09-14T07:12:02.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:02.062 INFO:teuthology.orchestra.run.smithi071.stdout:707 write 0xaa7814b thru 0xaa82740 (0xa5f6 bytes) 2024-09-14T07:12:02.075 INFO:teuthology.orchestra.run.smithi071.stdout:708 write 0xe14f38 thru 0xe15d01 (0xdca bytes) 2024-09-14T07:12:02.084 INFO:teuthology.orchestra.run.smithi071.stdout:710 write 0xc3b4311 thru 0xc3c0e33 (0xcb23 bytes) 2024-09-14T07:12:02.087 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:02.086+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:02.100 INFO:teuthology.orchestra.run.smithi071.stdout:712 write 0x1fbe318 thru 0x1fc1555 (0x323e bytes) 2024-09-14T07:12:02.106 INFO:teuthology.orchestra.run.smithi071.stdout:713 writesame 0xed376b thru 0xed9db5 data_size 0x2b(0x664b bytes) 2024-09-14T07:12:02.112 INFO:teuthology.orchestra.run.smithi071.stdout:715 write 0x1b4faba thru 0x1b542b2 (0x47f9 bytes) 2024-09-14T07:12:02.119 INFO:teuthology.orchestra.run.smithi071.stdout:716 writesame 0xae86506 thru 0xae8cd99 data_size 0x61(0x6894 bytes) 2024-09-14T07:12:02.125 INFO:teuthology.orchestra.run.smithi071.stdout:718 punch from 0xb8fbcb to 0xb91e1b, (0x2250 bytes) 2024-09-14T07:12:02.125 INFO:teuthology.orchestra.run.smithi071.stdout:719 punch from 0x13445f6 to 0x134cb53, (0x855d bytes) 2024-09-14T07:12:02.125 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:02.125 INFO:teuthology.orchestra.run.smithi071.stdout:721 write 0x9fac6db thru 0x9fb8c23 (0xc549 bytes) 2024-09-14T07:12:02.150 INFO:teuthology.orchestra.run.smithi071.stdout:723 write 0xd5d0da2 thru 0xd5d10df (0x33e bytes) 2024-09-14T07:12:02.167 INFO:teuthology.orchestra.run.smithi071.stdout:725 writesame 0xe2943c1 thru 0xe29c2c9 data_size 0x1(0x7f09 bytes) 2024-09-14T07:12:02.167 INFO:teuthology.orchestra.run.smithi071.stdout:726 read 0xaae37c6 thru 0xaaef56e (0xbda9 bytes) 2024-09-14T07:12:02.167 INFO:teuthology.orchestra.run.smithi071.stdout:727 read 0xa8ee6a9 thru 0xa8f0d8c (0x26e4 bytes) 2024-09-14T07:12:02.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout:728 trunc from 0xe29c2ca to 0x4b48794 2024-09-14T07:12:02.189 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:02.188+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:02.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:02.203 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:02.214 INFO:teuthology.orchestra.run.smithi071.stdout:729 read 0x2420f10 thru 0x24213b3 (0x4a4 bytes) 2024-09-14T07:12:02.214 INFO:teuthology.orchestra.run.smithi071.stdout:730 clone 5 order 25 su 8388608 sc 2 2024-09-14T07:12:02.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:02.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:02.253 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:02.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:02.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:12:02.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:12:02.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:02.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:02.290 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:02.290+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:02.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:02.303 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:02.308 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:02.308 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:02.308 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:02.308 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:02.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:02.402 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:02.401+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:02.413 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T07:12:02.413 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:02.413 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T07:12:02.414 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T07:12:02.414 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:12:02.445 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T07:12:02.446 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-09-14T07:12:02.446 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:12:02.446 DEBUG:teuthology.orchestra.run.smithi086:> type ceph-objectstore-tool 2024-09-14T07:12:02.461 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:02.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:02.462 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:02.462 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:02.462 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:02.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:02.500 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T07:12:02.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-09-14T07:12:02.512 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:02.511+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:02.595 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:02.594+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:726 3.8 3:17b00a5d:::rbd_data.1182c9370f88.000000000000000b:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:02.615 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8880678770000001, 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038570269999999999, 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 726 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725694+0000", 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725695+0000", 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.61e-07 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725699+0000", 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5789999999999997e-06 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725708+0000", 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6850000000000007e-06 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.725715+0000", 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2289999999999997e-06 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726565+0000", 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084992200000000003 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726638+0000", 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3034000000000006e-05 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726814+0000", 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000176236 2024-09-14T07:12:02.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.728283+0000", 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014683910000000001 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729493+0000", 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012097849999999999 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729525+0000", 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2484999999999998e-05 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.729551+0000", 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6020000000000002e-05 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1117 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:head [truncate 7340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:02.621 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.252464+0000", 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3612976110000004, 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084206439999999997, 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1117 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252464+0000", 2024-09-14T07:12:02.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252464+0000", 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252465+0000", 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6899999999999998e-07 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252467+0000", 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2850000000000001e-06 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252475+0000", 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6799999999999993e-06 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252486+0000", 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1148999999999999e-05 2024-09-14T07:12:02.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252892+0000", 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040611400000000001 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.252980+0000", 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7750000000000005e-05 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253118+0000", 2024-09-14T07:12:02.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013842800000000001 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.257813+0000", 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046946890000000002 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260818+0000", 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003005148 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260848+0000", 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9850999999999999e-05 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260885+0000", 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7081e-05 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1231 3.b 3:d53ce072:::rbd_data.11822ba09815.0000000000000012:head [delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.741493+0000", 2024-09-14T07:12:02.627 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.8722691149999999, 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004353198, 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1231 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741493+0000", 2024-09-14T07:12:02.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741493+0000", 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741495+0000", 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6279999999999999e-06 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741500+0000", 2024-09-14T07:12:02.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1200000000000001e-06 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741514+0000", 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4487e-05 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741522+0000", 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2439999999999993e-06 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741577+0000", 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4354000000000002e-05 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741638+0000", 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0949999999999998e-05 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741757+0000", 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119134 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745397+0000", 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036406670000000002 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745753+0000", 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035554100000000002 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745804+0000", 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0989000000000003e-05 2024-09-14T07:12:02.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.745846+0000", 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2083999999999999e-05 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1232 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:head [delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.8722192849999999, 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070039159999999998, 2024-09-14T07:12:02.633 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1232 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741543+0000", 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741546+0000", 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5299999999999999e-06 2024-09-14T07:12:02.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741552+0000", 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7850000000000003e-06 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.741558+0000", 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5130000000000004e-06 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742315+0000", 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075694499999999997 2024-09-14T07:12:02.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742389+0000", 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3674e-05 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742538+0000", 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149321 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748270+0000", 2024-09-14T07:12:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00573158 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748453+0000", 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018315599999999999 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748503+0000", 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9848000000000001e-05 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748547+0000", 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4115e-05 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1293 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:head [truncate 7340032] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.759493+0000", 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.8542685900000002, 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033708649999999998, 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.639 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1293 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759493+0000", 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759493+0000", 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759494+0000", 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9100000000000003e-07 2024-09-14T07:12:02.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759498+0000", 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759506+0000", 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5390000000000007e-06 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759513+0000", 2024-09-14T07:12:02.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7700000000000004e-06 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760475+0000", 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096228000000000004 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760560+0000", 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4338999999999993e-05 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760732+0000", 2024-09-14T07:12:02.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017279599999999999 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761732+0000", 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010000860000000001 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762799+0000", 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010668800000000001 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762828+0000", 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8702000000000001e-05 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762864+0000", 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6220999999999998e-05 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1446 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:5 [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7397764769999999, 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028253739999999999, 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1446 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873986+0000", 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873988+0000", 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7489999999999999e-06 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873994+0000", 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.873998+0000", 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0849999999999999e-06 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876628+0000", 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026305209999999998 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876714+0000", 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5500999999999993e-05 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876811+0000", 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7261000000000003e-05 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.649 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1447 3.b 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7397543789999999, 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003018789, 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.650 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1447 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874008+0000", 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874011+0000", 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4819999999999999e-06 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874018+0000", 2024-09-14T07:12:02.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6309999999999997e-06 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.874023+0000", 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1240000000000004e-06 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876858+0000", 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028351100000000001 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.876930+0000", 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1181999999999997e-05 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.877026+0000", 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6884000000000003e-05 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1593 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:12:02.654 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6999122600000001, 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002942933, 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1593 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:12:02.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913850+0000", 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7100000000000002e-07 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913853+0000", 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2900000000000001e-06 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913859+0000", 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3300000000000004e-06 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913864+0000", 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0329999999999999e-06 2024-09-14T07:12:02.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916597+0000", 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002733465 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916687+0000", 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0024000000000004e-05 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916793+0000", 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010532 2024-09-14T07:12:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1594 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913873+0000", 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6998885769999998, 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031053349999999999, 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1594 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913873+0000", 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913873+0000", 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913874+0000", 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7399999999999998e-07 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913876+0000", 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0040000000000002e-06 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913882+0000", 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0310000000000004e-06 2024-09-14T07:12:02.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913887+0000", 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8250000000000004e-06 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916830+0000", 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002943527 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916887+0000", 2024-09-14T07:12:02.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6385000000000003e-05 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.916979+0000", 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2089000000000005e-05 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1595 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6998671320000001, 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033134089999999998, 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1595 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.664 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913895+0000", 2024-09-14T07:12:02.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2300000000000002e-07 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913897+0000", 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7910000000000001e-06 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913910+0000", 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2585999999999999e-05 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913915+0000", 2024-09-14T07:12:02.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1580000000000004e-06 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917019+0000", 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031038189999999998 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917099+0000", 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0150999999999999e-05 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917208+0000", 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109481 2024-09-14T07:12:02.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1596 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6998403770000001, 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034916629999999999, 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1596 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913922+0000", 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1600000000000002e-07 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913925+0000", 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913930+0000", 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1120000000000004e-06 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.913934+0000", 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.805e-06 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917235+0000", 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033017210000000001 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917316+0000", 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0455000000000001e-05 2024-09-14T07:12:02.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.917413+0000", 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7503999999999993e-05 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1794 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.977041+0000", 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6367206080000001, 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028551200000000001, 2024-09-14T07:12:02.672 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1794 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977041+0000", 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977041+0000", 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977042+0000", 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977044+0000", 2024-09-14T07:12:02.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.813e-06 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977050+0000", 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.195e-06 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977054+0000", 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6750000000000001e-06 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.979746+0000", 2024-09-14T07:12:02.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026917820000000002 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.979819+0000", 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2379999999999995e-05 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.979897+0000", 2024-09-14T07:12:02.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7877e-05 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1795 3.2 3:414e58a4:::rbd_data.11822ba09815.0000000000000001:5 [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.977087+0000", 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6366750479999999, 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002990941, 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1795 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977087+0000", 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977087+0000", 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977088+0000", 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2600000000000002e-07 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977091+0000", 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8530000000000002e-06 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977099+0000", 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8650000000000001e-06 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.977105+0000", 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2399999999999998e-06 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.979919+0000", 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028146389999999999 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.979996+0000", 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6365000000000005e-05 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.980078+0000", 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2353000000000002e-05 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1897 3.19 e29/23 3:9b8485ad:::rbd_data.1182823d0fd0.0000000000000005:head v 29'6, mlcod=28'4)", 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.043313+0000", 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.570449124, 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003420415, 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043313+0000", 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043313+0000", 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043314+0000", 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.339e-06 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043323+0000", 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3520000000000007e-06 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043342+0000", 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9327999999999999e-05 2024-09-14T07:12:02.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043354+0000", 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1851999999999999e-05 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043424+0000", 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9938999999999996e-05 2024-09-14T07:12:02.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.043447+0000", 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3768999999999999e-05 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.046692+0000", 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003244355 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.046733+0000", 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1480999999999998e-05 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1994 3.8 3:14853814:::rbd_header.1182823d0fd0:head [call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.084992+0000", 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.5287696880000001, 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038889409999999999, 2024-09-14T07:12:02.686 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1994 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.084992+0000", 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.084992+0000", 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.084993+0000", 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2699999999999999e-07 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.084997+0000", 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.968e-06 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.085007+0000", 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8910000000000007e-06 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.085012+0000", 2024-09-14T07:12:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2279999999999998e-06 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.085055+0000", 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2602999999999999e-05 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.085107+0000", 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1777000000000002e-05 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.085281+0000", 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017478099999999999 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.085737+0000", 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000455282 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.088827+0000", 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003090275 2024-09-14T07:12:02.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.088857+0000", 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9822999999999999e-05 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.088881+0000", 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4586000000000001e-05 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2075 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.182440+0000", 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.4313221440000001, 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078463449999999994, 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2075 2024-09-14T07:12:02.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182440+0000", 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182440+0000", 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182441+0000", 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4199999999999995e-07 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182445+0000", 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0890000000000002e-06 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182454+0000", 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5410000000000006e-06 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182459+0000", 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7700000000000001e-06 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182504+0000", 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5238999999999998e-05 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.182582+0000", 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7853000000000002e-05 2024-09-14T07:12:02.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.183505+0000", 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092265299999999995 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.187633+0000", 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041283220000000002 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.190139+0000", 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025054779999999998 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.190224+0000", 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5789000000000001e-05 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.190286+0000", 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1869e-05 2024-09-14T07:12:02.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2212 3.1e 3:7dba856b:::rbd_data.1182823d0fd0.0000000000000022:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.391584+0000", 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.222178091, 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081101660000000002, 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2212 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391584+0000", 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391584+0000", 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391586+0000", 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0660000000000002e-06 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391593+0000", 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4209999999999998e-06 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391610+0000", 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391618+0000", 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4619999999999999e-06 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391681+0000", 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3371e-05 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391772+0000", 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0969000000000003e-05 2024-09-14T07:12:02.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.391881+0000", 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108727 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.392514+0000", 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063319799999999996 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.399600+0000", 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070859460000000001 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.399652+0000", 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2507999999999999e-05 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.399694+0000", 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1780000000000003e-05 2024-09-14T07:12:02.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2397 3.2 3:4722c105:::rbd_data.1182823d0fd0.0000000000000052:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.622951+0000", 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9908109380000001, 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039589660000000004, 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2397 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.622951+0000", 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.622951+0000", 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.622952+0000", 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.622954+0000", 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3e-06 2024-09-14T07:12:02.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.622964+0000", 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0446e-05 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.622968+0000", 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1230000000000002e-06 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.623030+0000", 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1178000000000003e-05 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.623112+0000", 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2139999999999996e-05 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:12:02.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.623222+0000", 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109787 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.623758+0000", 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053616199999999997 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.626858+0000", 2024-09-14T07:12:02.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031003810000000001 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.626887+0000", 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8537000000000001e-05 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.626910+0000", 2024-09-14T07:12:02.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3422e-05 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2400 3.8 3:14853814:::rbd_header.1182823d0fd0:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.631222+0000", 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9825397909999998, 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034153030000000002, 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2400 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631222+0000", 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631222+0000", 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631223+0000", 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.61e-07 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631227+0000", 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0459999999999999e-06 2024-09-14T07:12:02.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631237+0000", 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0447e-05 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631244+0000", 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.99e-06 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631290+0000", 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5796e-05 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631342+0000", 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1557000000000001e-05 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.631469+0000", 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012718000000000001 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.632089+0000", 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061965999999999996 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.634527+0000", 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024380140000000001 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.634598+0000", 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1390000000000006e-05 2024-09-14T07:12:02.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.634638+0000", 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2620 3.b 3:d7b032e9:::rbd_data.1182823d0fd0.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1114112~12766] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.891420+0000", 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.7223424920000001, 2024-09-14T07:12:02.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039167309999999997, 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2620 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891420+0000", 2024-09-14T07:12:02.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891420+0000", 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891420+0000", 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8400000000000003e-07 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891430+0000", 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6760000000000002e-06 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891440+0000", 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7860000000000008e-06 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891445+0000", 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0799999999999996e-06 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891490+0000", 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4907999999999998e-05 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891581+0000", 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1298999999999994e-05 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.891666+0000", 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4747999999999996e-05 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.895132+0000", 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034665899999999999 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.895243+0000", 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110099 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.895297+0000", 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4608999999999998e-05 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:02.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.895336+0000", 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9051999999999998e-05 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:02.725 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:02.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:02.727 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:12:02.728 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:02.725+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:02.827 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:02.826+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:02.829 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:02.830 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:02.830 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:02.830 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:02.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.d 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.c 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.1f 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.1c 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.17 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.16 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.5 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:3.1d 2024-09-14T07:12:02.908 INFO:teuthology.orchestra.run.smithi086.stdout:2.3 2024-09-14T07:12:02.909 INFO:teuthology.orchestra.run.smithi086.stdout:3.2 2024-09-14T07:12:02.909 INFO:teuthology.orchestra.run.smithi086.stdout:2.2 2024-09-14T07:12:02.928 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:02.927+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:02.943 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:02.943 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:02.943 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:02.943 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:02.944 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:02.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:03.040 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:03.039+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:03.098 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:03.098 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:03.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:03.098 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:03.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:53.641271+0000", 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4555618859999999, 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033780239999999999, 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641271+0000", 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641271+0000", 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641272+0000", 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.223e-06 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641278+0000", 2024-09-14T07:12:03.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2160000000000003e-06 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641289+0000", 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0957e-05 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641299+0000", 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6860000000000001e-06 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641347+0000", 2024-09-14T07:12:03.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8279000000000003e-05 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.641351+0000", 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.126e-06 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.643226+0000", 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018752560000000001 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.643295+0000", 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8225000000000005e-05 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.643377+0000", 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2303000000000001e-05 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644530+0000", 2024-09-14T07:12:03.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011526279999999999 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644596+0000", 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6447999999999998e-05 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644625+0000", 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9153999999999999e-05 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:53.644649+0000", 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3523000000000002e-05 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:727 3.f e28/23 3:f155f0d9:::rbd_data.1182c9370f88.000000000000000f:head v 28'60, mlcod=28'57)", 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:57.726369+0000", 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.3704633980000001, 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031828770000000002, 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.106 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726369+0000", 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726369+0000", 2024-09-14T07:12:03.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726370+0000", 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7300000000000001e-07 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726375+0000", 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0980000000000001e-06 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726640+0000", 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026564399999999999 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726648+0000", 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.323e-06 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726749+0000", 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101034 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.726771+0000", 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1772000000000001e-05 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.729482+0000", 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027116660000000002 2024-09-14T07:12:03.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:57.729552+0000", 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9867e-05 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:991 3.11 e28/23 3:88549360:::rbd_header.11822ba09815:head v 28'15, mlcod=28'13)", 2024-09-14T07:12:03.111 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.9574278940000003, 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032514559999999998, 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:12:03.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139405+0000", 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139418+0000", 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2762000000000001e-05 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139427+0000", 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8179999999999993e-06 2024-09-14T07:12:03.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139431+0000", 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6099999999999999e-06 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139476+0000", 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4838e-05 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.139497+0000", 2024-09-14T07:12:03.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0791000000000001e-05 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.142627+0000", 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003130037 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.142656+0000", 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8999000000000001e-05 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1750 3.11 e29/23 3:8e6097e5:::rbd_data.1182823d0fd0.0000000000000028:head v 29'35, mlcod=29'33)", 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.968942+0000", 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.1278904719999998, 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044981520000000001, 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968942+0000", 2024-09-14T07:12:03.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968942+0000", 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968943+0000", 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8899999999999999e-07 2024-09-14T07:12:03.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968947+0000", 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8310000000000003e-06 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968955+0000", 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0369999999999995e-06 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968960+0000", 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3229999999999997e-06 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969027+0000", 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6892999999999998e-05 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969045+0000", 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8609000000000001e-05 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973382+0000", 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043364340000000001 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973440+0000", 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8436000000000001e-05 2024-09-14T07:12:03.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1746 3.1b e29/23 3:db8f39e2:::rbd_data.1182823d0fd0.0000000000000010:head v 29'12, mlcod=29'10)", 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.969006+0000", 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.1278265340000004, 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044282389999999996, 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.122 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969006+0000", 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969006+0000", 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969007+0000", 2024-09-14T07:12:03.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7700000000000004e-07 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969013+0000", 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5490000000000003e-06 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969027+0000", 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3844e-05 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969034+0000", 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1199999999999996e-06 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969093+0000", 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8313000000000002e-05 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969111+0000", 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8573999999999999e-05 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973387+0000", 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042762499999999997 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973434+0000", 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6811999999999998e-05 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1752 3.1d e29/23 3:bab929bf:::rbd_data.1182823d0fd0.0000000000000041:head v 29'8, mlcod=29'6)", 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.969421+0000", 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.1274115330000001, 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040204480000000003, 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969421+0000", 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969421+0000", 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969422+0000", 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3799999999999997e-07 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969429+0000", 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.153e-06 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969441+0000", 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2036e-05 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969447+0000", 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5039999999999999e-06 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969495+0000", 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7624999999999999e-05 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969514+0000", 2024-09-14T07:12:03.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9341e-05 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973400+0000", 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038858569999999999 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973442+0000", 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1294000000000001e-05 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:1753 3.a e29/23 3:54733f3e:::rbd_data.1182823d0fd0.000000000000004e:head v 29'9, mlcod=29'6)", 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.969509+0000", 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.1273235980000003, 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039655510000000003, 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969509+0000", 2024-09-14T07:12:03.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969509+0000", 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969510+0000", 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3099999999999997e-07 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969515+0000", 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3399999999999997e-06 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969525+0000", 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0370999999999999e-05 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969532+0000", 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3249999999999996e-06 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969586+0000", 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4653e-05 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969603+0000", 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6266999999999999e-05 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973440+0000", 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038368629999999998 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973475+0000", 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5000999999999999e-05 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.136 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2124 3.1a 3:5e82dd18:::rbd_data.1182823d0fd0.0000000000000049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.241206+0000", 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.8556265830000003, 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003891294, 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2124 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241206+0000", 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241206+0000", 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241207+0000", 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.364e-06 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241212+0000", 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0980000000000001e-06 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241225+0000", 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2965999999999999e-05 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241231+0000", 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0009999999999998e-06 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241299+0000", 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7130000000000003e-05 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241402+0000", 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010309199999999999 2024-09-14T07:12:03.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.241534+0000", 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013255400000000001 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.242061+0000", 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052692199999999998 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.245024+0000", 2024-09-14T07:12:03.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029626040000000002 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.245055+0000", 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1741e-05 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.245097+0000", 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1822e-05 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2164 3.1a 3:59f81f62:::rbd_data.1182823d0fd0.0000000000000031:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7940828099999999, 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013431442, 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2164 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302751+0000", 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.003e-06 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302755+0000", 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059999999999996e-06 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302767+0000", 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1204e-05 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302772+0000", 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7270000000000004e-06 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302816+0000", 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3322999999999998e-05 2024-09-14T07:12:03.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302909+0000", 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3614000000000002e-05 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.304973+0000", 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020640609999999998 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316056+0000", 2024-09-14T07:12:03.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011082992 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316073+0000", 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6512e-05 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316128+0000", 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.469e-05 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316181+0000", 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3709999999999999e-05 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:2164 3.1a e29/23 ondisk, result = 0)", 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.311489+0000", 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7853438339999999, 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045762820000000001, 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:03.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311489+0000", 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311489+0000", 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311490+0000", 2024-09-14T07:12:03.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4e-07 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311494+0000", 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5700000000000003e-06 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311508+0000", 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3815000000000001e-05 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.311517+0000", 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5539999999999998e-06 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316038+0000", 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045217679999999998 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316049+0000", 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499000000000001e-05 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316065+0000", 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6135999999999999e-05 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2213 3.1a 3:59f81f62:::rbd_data.1182823d0fd0.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391592+0000", 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7052408579999998, 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0079048780000000006, 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2213 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391592+0000", 2024-09-14T07:12:03.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391592+0000", 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391594+0000", 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.984e-06 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391601+0000", 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4420000000000001e-06 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391619+0000", 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.802e-05 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391629+0000", 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9340000000000001e-06 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391701+0000", 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1637000000000005e-05 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391791+0000", 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9846999999999995e-05 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391918+0000", 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012690999999999999 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392684+0000", 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076658100000000001 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399427+0000", 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067427600000000004 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399468+0000", 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1480999999999998e-05 2024-09-14T07:12:03.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399497+0000", 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8282000000000001e-05 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2216 3.13 e29/23 3:cb9ca5de:::rbd_data.1182823d0fd0.000000000000005d:head v 29'14, mlcod=29'12)", 2024-09-14T07:12:03.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391915+0000", 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7049177000000002, 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059801890000000003, 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391915+0000", 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391915+0000", 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391916+0000", 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391924+0000", 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5549999999999997e-06 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391935+0000", 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1953999999999999e-05 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391942+0000", 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.024e-06 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392009+0000", 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6353999999999995e-05 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392029+0000", 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9896000000000001e-05 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.397848+0000", 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058196439999999997 2024-09-14T07:12:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.397895+0000", 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6687000000000002e-05 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2215 3.a e29/23 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head v 29'12, mlcod=29'10)", 2024-09-14T07:12:03.164 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.392028+0000", 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7048045690000002, 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074941870000000002, 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392028+0000", 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392028+0000", 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392029+0000", 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5700000000000002e-07 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392033+0000", 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392053+0000", 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9595000000000001e-05 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392061+0000", 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.456e-06 2024-09-14T07:12:03.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392134+0000", 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2822000000000002e-05 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392152+0000", 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8034999999999999e-05 2024-09-14T07:12:03.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399501+0000", 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0073484190000000001 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399522+0000", 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1613000000000001e-05 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2245 3.1a 3:5f792b6e:::rbd_data.1182823d0fd0.000000000000001d:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.433146+0000", 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.6636861779999998, 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087375230000000005, 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2245 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433146+0000", 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433146+0000", 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433148+0000", 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433155+0000", 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4599999999999997e-06 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433171+0000", 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5321000000000001e-05 2024-09-14T07:12:03.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433178+0000", 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0169999999999999e-06 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433231+0000", 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2979000000000002e-05 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.433332+0000", 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100979 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.434522+0000", 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001189816 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441729+0000", 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007207621 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441771+0000", 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2274999999999998e-05 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441828+0000", 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6249000000000003e-05 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441884+0000", 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6218999999999998e-05 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:2245 3.1a e29/23 ondisk, result = 0)", 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.658056894, 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031245349999999999, 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438776+0000", 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1999999999999999e-07 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438780+0000", 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1269999999999996e-06 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438790+0000", 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1120000000000002e-06 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.438794+0000", 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441755+0000", 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029602890000000001 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441764+0000", 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5300000000000002e-06 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.441900+0000", 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013599700000000001 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2395 3.a e29/23 3:51811f96:::rbd_data.1182823d0fd0.0000000000000046:head v 29'16, mlcod=29'14)", 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.623272+0000", 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.4735609059999999, 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003340057, 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623272+0000", 2024-09-14T07:12:03.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623272+0000", 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623273+0000", 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5499999999999997e-07 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623278+0000", 2024-09-14T07:12:03.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5520000000000004e-06 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623291+0000", 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2867999999999999e-05 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623298+0000", 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6329999999999999e-06 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623376+0000", 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8359e-05 2024-09-14T07:12:03.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623393+0000", 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7421000000000001e-05 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.626556+0000", 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003162279 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.626612+0000", 2024-09-14T07:12:03.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.609e-05 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2396 3.1c e29/23 3:3ae2fa0a:::rbd_data.1182823d0fd0.0000000000000047:head v 29'20, mlcod=29'18)", 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.623727+0000", 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.4731055460000002, 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055010780000000004, 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623727+0000", 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623727+0000", 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623728+0000", 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-07 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623734+0000", 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2140000000000001e-06 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623748+0000", 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3747000000000001e-05 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623755+0000", 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.793e-06 2024-09-14T07:12:03.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623817+0000", 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2032000000000005e-05 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.623837+0000", 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0152999999999998e-05 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.629192+0000", 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053556410000000004 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.629228+0000", 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5781999999999997e-05 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2513 3.13 e30/23 3:cb9ca5de:::rbd_data.1182823d0fd0.000000000000005d:head v 30'20, mlcod=29'18)", 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.748171+0000", 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3486611769999999, 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003458741, 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748171+0000", 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748171+0000", 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748172+0000", 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9800000000000003e-07 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748178+0000", 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3979999999999998e-06 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748192+0000", 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.429e-05 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748201+0000", 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0510000000000002e-06 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748260+0000", 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9033000000000002e-05 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748281+0000", 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1324000000000001e-05 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751596+0000", 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033150760000000001 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751630+0000", 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3871000000000001e-05 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.194 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2512 3.a e30/23 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head v 30'23, mlcod=30'20)", 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.748233+0000", 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3485993860000001, 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034034239999999999, 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748233+0000", 2024-09-14T07:12:03.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748233+0000", 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748234+0000", 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5299999999999999e-07 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748238+0000", 2024-09-14T07:12:03.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0149999999999997e-06 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748251+0000", 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3621000000000001e-05 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748257+0000", 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4090000000000002e-06 2024-09-14T07:12:03.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748300+0000", 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2828999999999999e-05 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.748317+0000", 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7365000000000001e-05 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751608+0000", 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032907029999999999 2024-09-14T07:12:03.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751637+0000", 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9028999999999999e-05 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2532 3.1 e30/23 3:872b0234:::rbd_data.1182823d0fd0.0000000000000023:head v 30'13, mlcod=29'10)", 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.768087+0000", 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3287455750000001, 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003893802, 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768087+0000", 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768087+0000", 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768088+0000", 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6700000000000003e-07 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768095+0000", 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5429999999999996e-06 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768105+0000", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0198e-05 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768112+0000", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1639999999999998e-06 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768157+0000", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5323e-05 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.768174+0000", 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.668e-05 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.771954+0000", 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037809129999999999 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.771981+0000", 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6313999999999999e-05 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.203 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.204 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.204 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:03.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:03.206 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 3.c --file /var/log/ceph/exp.3.c.5 2024-09-14T07:12:03.206 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:03.204+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:03.306 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:03.305+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:03.351 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:03.351 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:03.351 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:03.351 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:03.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:03.406 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:03.406+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:03.462 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:03.462 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:03.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:03.508 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:03.507+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:03.609 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:03.608+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:03.616 INFO:teuthology.orchestra.run.smithi086.stderr:Exporting 3.c info 3.c( v 32'24 (0'0,32'24] local-lis/les=23/24 n=3 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-14T07:12:03.616 INFO:teuthology.orchestra.run.smithi086.stderr:Read #3:30c029c9:::rbd_data.1182823d0fd0.0000000000000007:head# 2024-09-14T07:12:03.618 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:03.618 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:03.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:955 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5194780120000004, 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049726400000000004, 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.619 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 955 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7800000000000002e-07 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096857+0000", 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5500000000000001e-06 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096863+0000", 2024-09-14T07:12:03.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8069999999999996e-06 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096867+0000", 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.099471+0000", 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026034069999999999 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.099524+0000", 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2979000000000002e-05 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.099755+0000", 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023132400000000001 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101388+0000", 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001632887 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101734+0000", 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034561800000000001 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101784+0000", 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0333000000000001e-05 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101827+0000", 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2638000000000001e-05 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:956 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.096874+0000", 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5194577670000005, 2024-09-14T07:12:03.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064521819999999999, 2024-09-14T07:12:03.626 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 956 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096874+0000", 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096874+0000", 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096875+0000", 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4499999999999997e-07 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096878+0000", 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4589999999999998e-06 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096884+0000", 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1430000000000003e-06 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096895+0000", 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0522e-05 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.100543+0000", 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036484640000000001 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.100623+0000", 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9264999999999994e-05 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101014+0000", 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039168699999999999 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.102551+0000", 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015364479999999999 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.103273+0000", 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072191900000000001 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.103299+0000", 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6656e-05 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.103326+0000", 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7174000000000001e-05 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:970 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.108067+0000", 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.5082653610000003, 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040265209999999999, 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 970 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108067+0000", 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108067+0000", 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108067+0000", 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6000000000000003e-07 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108071+0000", 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9940000000000002e-06 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108081+0000", 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6339999999999996e-06 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108090+0000", 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5569999999999996e-06 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108129+0000", 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9768000000000003e-05 2024-09-14T07:12:03.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108180+0000", 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1073999999999999e-05 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108320+0000", 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014001700000000001 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.108802+0000", 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048110600000000002 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.112037+0000", 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032351429999999998 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.112069+0000", 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2685999999999998e-05 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.112093+0000", 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3782e-05 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.639 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:978 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.122352+0000", 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.4939803339999997, 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043801029999999998, 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 978 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.640 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122352+0000", 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122352+0000", 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122354+0000", 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0600000000000002e-06 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122371+0000", 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.774e-05 2024-09-14T07:12:03.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122382+0000", 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0156000000000001e-05 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122386+0000", 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122462+0000", 2024-09-14T07:12:03.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5841999999999997e-05 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122514+0000", 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1725999999999999e-05 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122655+0000", 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014141100000000001 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.123214+0000", 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055832699999999996 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.126673+0000", 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003459564 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.126705+0000", 2024-09-14T07:12:03.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2203000000000003e-05 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.126732+0000", 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6347999999999999e-05 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1120 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.262321+0000", 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.354011131, 2024-09-14T07:12:03.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040787640000000003, 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1120 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262321+0000", 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262321+0000", 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262322+0000", 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0699999999999996e-07 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262327+0000", 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262337+0000", 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0217999999999999e-05 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262343+0000", 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1100000000000002e-06 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262383+0000", 2024-09-14T07:12:03.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9981999999999998e-05 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262434+0000", 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1544e-05 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.262580+0000", 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014587700000000001 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.263081+0000", 2024-09-14T07:12:03.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000500743 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.266342+0000", 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032615000000000001 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.266374+0000", 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2289000000000002e-05 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.266400+0000", 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5205999999999999e-05 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1243 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.751636+0000", 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8646957950000003, 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042574830000000003, 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.652 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1243 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751636+0000", 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751636+0000", 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751637+0000", 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1900000000000003e-07 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751640+0000", 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1410000000000001e-06 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751646+0000", 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4080000000000003e-06 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751651+0000", 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9729999999999997e-06 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752844+0000", 2024-09-14T07:12:03.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011923089999999999 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752944+0000", 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9946999999999997e-05 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753319+0000", 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000375027 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755746+0000", 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024272859999999999 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755795+0000", 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9394999999999997e-05 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755847+0000", 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2017e-05 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755894+0000", 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6461000000000001e-05 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1266 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.751948+0000", 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8643843120000003, 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040308499999999999, 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1266 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751948+0000", 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751948+0000", 2024-09-14T07:12:03.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751949+0000", 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9400000000000004e-07 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751954+0000", 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9490000000000004e-06 2024-09-14T07:12:03.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751965+0000", 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1127e-05 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751972+0000", 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1629999999999999e-06 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754010+0000", 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020385080000000001 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754095+0000", 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4369999999999994e-05 2024-09-14T07:12:03.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754459+0000", 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036432899999999999 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755779+0000", 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001320335 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755904+0000", 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012451399999999999 2024-09-14T07:12:03.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755950+0000", 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5877999999999997e-05 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755979+0000", 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8782999999999999e-05 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1267 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.751991+0000", 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8643408539999999, 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064042830000000002, 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1267 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751991+0000", 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751991+0000", 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751992+0000", 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4499999999999997e-07 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751998+0000", 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.037e-06 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752006+0000", 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0669999999999992e-06 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752012+0000", 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.835e-06 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754875+0000", 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028632430000000001 2024-09-14T07:12:03.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754967+0000", 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2492999999999997e-05 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755326+0000", 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000358105 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757633+0000", 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023071609999999998 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758294+0000", 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066165799999999997 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758355+0000", 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0837e-05 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758395+0000", 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0302000000000001e-05 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1268 3.10 3:0e7e991f:::rbd_data.1182c9370f88.0000000000000000:4 [sparse-read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.752063+0000", 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8642691420000004, 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041521129999999998, 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1268 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752063+0000", 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752063+0000", 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752064+0000", 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8100000000000001e-07 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752069+0000", 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7450000000000003e-06 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752088+0000", 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8895000000000001e-05 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752098+0000", 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0601000000000001e-05 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756012+0000", 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039134829999999997 2024-09-14T07:12:03.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756103+0000", 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1365000000000004e-05 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756215+0000", 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112043 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.675 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1277 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.753269+0000", 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8630629860000001, 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059202710000000004, 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.676 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1277 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753269+0000", 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753269+0000", 2024-09-14T07:12:03.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753270+0000", 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.61e-07 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753275+0000", 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3260000000000003e-06 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753282+0000", 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753287+0000", 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6920000000000001e-06 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756243+0000", 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029560739999999999 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756297+0000", 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4103e-05 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756603+0000", 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030542399999999999 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758402+0000", 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001799695 2024-09-14T07:12:03.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759094+0000", 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069117600000000005 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759149+0000", 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5859000000000002e-05 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759189+0000", 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9909e-05 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1279 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8629113669999997, 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058589460000000003, 2024-09-14T07:12:03.682 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1279 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3399999999999999e-07 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753425+0000", 2024-09-14T07:12:03.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.495e-06 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753433+0000", 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8299999999999996e-06 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753440+0000", 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9670000000000004e-06 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756961+0000", 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035209199999999999 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757034+0000", 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3098999999999999e-05 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757278+0000", 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024468599999999998 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759042+0000", 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00176337 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759230+0000", 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018805100000000001 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759256+0000", 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6325e-05 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759280+0000", 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3569000000000001e-05 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1281 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.753668+0000", 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8626641519999998, 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064311359999999996, 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1281 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753668+0000", 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753668+0000", 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753669+0000", 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8400000000000003e-07 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753673+0000", 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.031e-06 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753680+0000", 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6510000000000001e-06 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753685+0000", 2024-09-14T07:12:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7029999999999997e-06 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757686+0000", 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040011150000000004 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757766+0000", 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0121000000000001e-05 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758020+0000", 2024-09-14T07:12:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418100000000002 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759288+0000", 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012676829999999999 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760016+0000", 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000727365 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760071+0000", 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5685e-05 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760099+0000", 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7817000000000002e-05 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1283 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8623043160000003, 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069480920000000003, 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1283 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6199999999999997e-07 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754032+0000", 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5200000000000002e-06 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754039+0000", 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9779999999999999e-06 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754043+0000", 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4309999999999996e-06 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758424+0000", 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004380803 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758506+0000", 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2081000000000002e-05 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758787+0000", 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028124999999999998 2024-09-14T07:12:03.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759977+0000", 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001189474 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760881+0000", 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00090457199999999997 2024-09-14T07:12:03.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760940+0000", 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8041999999999998e-05 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760976+0000", 2024-09-14T07:12:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6279000000000003e-05 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1288 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.756918+0000", 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.859413838, 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047051740000000003, 2024-09-14T07:12:03.702 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1288 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756918+0000", 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756918+0000", 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756919+0000", 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0279999999999999e-06 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756924+0000", 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8550000000000001e-06 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756931+0000", 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0029999999999997e-06 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756936+0000", 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9280000000000001e-06 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759317+0000", 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002381387 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759401+0000", 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3236000000000001e-05 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:03.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759689+0000", 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028833 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760290+0000", 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000600561 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.761534+0000", 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012445170000000001 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.761584+0000", 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0019999999999999e-05 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.761623+0000", 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9308999999999999e-05 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.708 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1753 3.a 3:54733f3e:::rbd_data.1182823d0fd0.000000000000004e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.968631+0000", 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.6477008020000001, 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050848289999999999, 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1753 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968631+0000", 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968631+0000", 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968632+0000", 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4000000000000001e-07 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968639+0000", 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9979999999999997e-06 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968654+0000", 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5058000000000001e-05 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968663+0000", 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9420000000000001e-06 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969059+0000", 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039654099999999998 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969132+0000", 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2762999999999994e-05 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969231+0000", 2024-09-14T07:12:03.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8504000000000004e-05 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973409+0000", 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041781270000000002 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973606+0000", 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196978 2024-09-14T07:12:03.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973676+0000", 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0494999999999995e-05 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973716+0000", 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9783000000000002e-05 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2210 3.a 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.367851+0000", 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2484806590000002, 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01116641, 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2210 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.715 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367851+0000", 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367851+0000", 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367853+0000", 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7850000000000001e-06 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367863+0000", 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5319999999999995e-06 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367879+0000", 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858e-05 2024-09-14T07:12:03.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367886+0000", 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0450000000000003e-06 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367944+0000", 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8585000000000002e-05 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.368040+0000", 2024-09-14T07:12:03.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5595999999999997e-05 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.369684+0000", 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001644284 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378898+0000", 2024-09-14T07:12:03.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0092138959999999992 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378913+0000", 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4594e-05 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378965+0000", 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2830000000000001e-05 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.379018+0000", 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2404999999999997e-05 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:2210 3.a e29/23 ondisk, result = 0)", 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.374818+0000", 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2415136660000003, 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040851280000000004, 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.721 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.374818+0000", 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.374818+0000", 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.374819+0000", 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6199999999999997e-07 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.374824+0000", 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8130000000000003e-06 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.374838+0000", 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.451e-05 2024-09-14T07:12:03.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.374847+0000", 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6789999999999994e-06 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378882+0000", 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040345870000000001 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378893+0000", 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1729000000000001e-05 2024-09-14T07:12:03.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378903+0000", 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0047999999999999e-05 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2215 3.a 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391603+0000", 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2247290360000003, 2024-09-14T07:12:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080817279999999998, 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2215 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391603+0000", 2024-09-14T07:12:03.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391603+0000", 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391604+0000", 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5030000000000001e-06 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391611+0000", 2024-09-14T07:12:03.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4500000000000001e-06 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391626+0000", 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5475999999999999e-05 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391638+0000", 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.147e-05 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391702+0000", 2024-09-14T07:12:03.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3740999999999998e-05 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391787+0000", 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5054000000000003e-05 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391898+0000", 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110998 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.397808+0000", 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059105540000000002 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399624+0000", 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00181616 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399657+0000", 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3071000000000002e-05 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399685+0000", 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7251e-05 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2212 3.1e e29/23 3:7dba856b:::rbd_data.1182823d0fd0.0000000000000022:head v 29'6, mlcod=29'4)", 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391980+0000", 2024-09-14T07:12:03.731 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.2243519430000003, 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074371309999999996, 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391980+0000", 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391980+0000", 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391981+0000", 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0800000000000004e-07 2024-09-14T07:12:03.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391988+0000", 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9290000000000001e-06 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391998+0000", 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0553999999999999e-05 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392005+0000", 2024-09-14T07:12:03.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.759e-06 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392059+0000", 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4187000000000001e-05 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392079+0000", 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9930999999999999e-05 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399373+0000", 2024-09-14T07:12:03.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007294015 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399417+0000", 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3948e-05 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2512 3.a 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.747734+0000", 2024-09-14T07:12:03.736 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.86859843, 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041273009999999999, 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2512 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747734+0000", 2024-09-14T07:12:03.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747734+0000", 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747734+0000", 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1699999999999997e-07 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:03.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747738+0000", 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4460000000000001e-06 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747750+0000", 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.259e-05 2024-09-14T07:12:03.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747757+0000", 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7259999999999996e-06 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747806+0000", 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8714999999999997e-05 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747879+0000", 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2787999999999995e-05 2024-09-14T07:12:03.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.747986+0000", 2024-09-14T07:12:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010694 2024-09-14T07:12:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.749802+0000", 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018167929999999999 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751756+0000", 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019539090000000002 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:03.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751815+0000", 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8742000000000001e-05 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.751861+0000", 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5935e-05 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:03.745 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:03.745 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:03.745 INFO:teuthology.orchestra.run.smithi086.stderr:Read #3:32b8ddd0:::rbd_data.1182f1e71464.0000000000000001:head# 2024-09-14T07:12:03.745 INFO:teuthology.orchestra.run.smithi086.stderr:Read #3:3701356a:::rbd_data.1182f1e71464.0000000000000011:head# 2024-09-14T07:12:03.745 INFO:teuthology.orchestra.run.smithi086.stderr:Export successful 2024-09-14T07:12:03.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:03.747 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:03.747+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:03.757 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone4 from 0x4b48794 (overlap 0x1051dca) to 0xb6c80d 2024-09-14T07:12:03.841 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-14T07:12:03.849 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:03.848+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:03.858 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:03.858 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:03.858 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:03.858 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:03.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:03.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 3.c 2024-09-14T07:12:03.927 INFO:teuthology.orchestra.run.smithi071.stdout:731 punch from 0x326743e to 0x326d237, (0x5df9 bytes) 2024-09-14T07:12:03.931 INFO:teuthology.orchestra.run.smithi071.stdout:732 read 0x45824b7 thru 0x458fc05 (0xd74f bytes) 2024-09-14T07:12:03.931 INFO:teuthology.orchestra.run.smithi071.stdout:733 read 0x1c3744b thru 0x1c3ca3c (0x55f2 bytes) 2024-09-14T07:12:03.931 INFO:teuthology.orchestra.run.smithi071.stdout:734 read 0x20c83b thru 0x211948 (0x510e bytes) 2024-09-14T07:12:03.946 INFO:teuthology.orchestra.run.smithi071.stdout:735 write 0xc100d4c thru 0xc10a746 (0x99fb bytes) 2024-09-14T07:12:03.950 INFO:teuthology.orchestra.run.smithi071.stdout:738 punch from 0x6fcb013 to 0x6fd06db, (0x56c8 bytes) 2024-09-14T07:12:03.957 INFO:teuthology.orchestra.run.smithi071.stdout:739 trunc from 0xc10a747 to 0x5cd54ba 2024-09-14T07:12:03.971 INFO:teuthology.orchestra.run.smithi071.stdout:741 punch from 0x28b931e to 0x28c70cd, (0xddaf bytes) 2024-09-14T07:12:03.971 INFO:teuthology.orchestra.run.smithi071.stdout:742 read 0x679b65 thru 0x67abde (0x107a bytes) 2024-09-14T07:12:03.972 INFO:teuthology.orchestra.run.smithi071.stdout:743 write 0x21fa2ff thru 0x220a177 (0xfe79 bytes) 2024-09-14T07:12:03.980 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:03.980 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:03.980 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:03.980 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:03.980 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:03.981 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:03.979+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:03.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:04.050 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:04.049+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:04.117 INFO:teuthology.orchestra.run.smithi071.stdout:744 writesame 0x8ebc5f3 thru 0x8ec3e1f data_size 0x23(0x782d bytes) 2024-09-14T07:12:04.117 INFO:teuthology.orchestra.run.smithi071.stdout:745 write 0x4a7edb4 thru 0x4a7fae0 (0xd2d bytes) 2024-09-14T07:12:04.119 INFO:teuthology.orchestra.run.smithi071.stdout:747 trunc from 0x8ec3e20 to 0x85689b6 2024-09-14T07:12:04.124 INFO:teuthology.orchestra.run.smithi071.stdout:748 punch from 0x1ac1319 to 0x1aca3f7, (0x90de bytes) 2024-09-14T07:12:04.124 INFO:teuthology.orchestra.run.smithi071.stdout:749 punch from 0x51f8ef5 to 0x51febd4, (0x5cdf bytes) 2024-09-14T07:12:04.132 INFO:teuthology.orchestra.run.smithi071.stdout:750 trunc from 0x85689b6 to 0xff0d19 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.012694873000001, 2024-09-14T07:12:04.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:04.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:04.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:04.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.457378351, 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:04.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8693 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1941504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.169894923, 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033512578000000001, 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8693 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.163 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977710+0000", 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3500000000000005e-07 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977713+0000", 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.123e-06 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977716+0000", 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9919999999999999e-06 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011124+0000", 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033407729999999997 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011161+0000", 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6729e-05 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011222+0000", 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0961999999999997e-05 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8695 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1982464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.16977272700000001, 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033512594, 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8695 2024-09-14T07:12:04.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977832+0000", 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7800000000000001e-07 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977834+0000", 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2520000000000002e-06 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977840+0000", 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9619999999999998e-06 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977843+0000", 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0989999999999999e-06 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011245+0000", 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033401765 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011281+0000", 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5824999999999997e-05 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011344+0000", 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8696 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 2076672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.169755816, 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033630489999999999, 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.172 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8696 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0100000000000001e-07 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977849+0000", 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6500000000000008e-07 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977852+0000", 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.976e-06 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977855+0000", 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3199999999999998e-06 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011365+0000", 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033510256000000002 2024-09-14T07:12:04.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011403+0000", 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7768000000000002e-05 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011479+0000", 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6003999999999999e-05 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8853 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.168500863, 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033449174999999998, 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8853 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.84e-07 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979105+0000", 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1449999999999998e-06 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979108+0000", 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8710000000000001e-06 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979112+0000", 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2830000000000002e-06 2024-09-14T07:12:04.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012548+0000", 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033436216999999997 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012552+0000", 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3749999999999996e-06 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8854 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.16848943399999999, 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033459328000000003, 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.181 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8854 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979115+0000", 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9299999999999999e-07 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979116+0000", 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6199999999999996e-07 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979119+0000", 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8789999999999999e-06 2024-09-14T07:12:04.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979121+0000", 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.401e-06 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012569+0000", 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033448569999999997 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012574+0000", 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3229999999999999e-06 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8855 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.16848028600000001, 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033472147000000001, 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8855 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.03e-07 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979125+0000", 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6899999999999996e-07 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979127+0000", 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979131+0000", 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1750000000000001e-06 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012592+0000", 2024-09-14T07:12:04.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033460999999999998 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012596+0000", 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1869999999999999e-06 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8856 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.16847041099999999, 2024-09-14T07:12:04.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033482968000000002, 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8856 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979163+0000", 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9280000000000001e-05 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979165+0000", 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4169999999999999e-06 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979169+0000", 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1690000000000002e-06 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979173+0000", 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0210000000000001e-06 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012612+0000", 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033438864999999998 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012616+0000", 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.216e-06 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8857 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.16842592300000001, 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.03345882, 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8857 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979611+0000", 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000433423 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979617+0000", 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0750000000000003e-06 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979622+0000", 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9949999999999996e-06 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979627+0000", 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3290000000000004e-06 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012632+0000", 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033005372999999998 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012637+0000", 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6249999999999998e-06 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.197 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9390 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 847872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.13000998799999999, 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033450345999999999, 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9390 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:04.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.58e-07 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017596+0000", 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.933e-06 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017602+0000", 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7089999999999999e-06 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017606+0000", 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5480000000000003e-06 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.050935+0000", 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033328363 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.050977+0000", 2024-09-14T07:12:04.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1696999999999997e-05 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051044+0000", 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7737999999999994e-05 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9392 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 888832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:04.202 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.12999210999999999, 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033568649999999998, 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9392 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017614+0000", 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.708e-06 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017620+0000", 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7100000000000004e-06 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017624+0000", 2024-09-14T07:12:04.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6840000000000004e-06 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051070+0000", 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033445526000000003 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051110+0000", 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0615999999999999e-05 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051180+0000", 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0092999999999995e-05 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9394 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 929792~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.12996449199999999, 2024-09-14T07:12:04.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033671397999999998, 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9394 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:04.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017640+0000", 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9599999999999999e-07 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017642+0000", 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0849999999999999e-06 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017650+0000", 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017655+0000", 2024-09-14T07:12:04.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4249999999999997e-06 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051205+0000", 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033549686000000002 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051244+0000", 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319000000000001e-05 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051311+0000", 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6759000000000002e-05 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9396 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1024000~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.12994260899999999, 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033788708000000001, 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9396 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017662+0000", 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000002e-07 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017664+0000", 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.773e-06 2024-09-14T07:12:04.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017670+0000", 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017674+0000", 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7140000000000001e-06 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051335+0000", 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033660836999999999 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051377+0000", 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2080999999999999e-05 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051450+0000", 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2856999999999997e-05 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.216 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9398 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1064960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.12992399900000001, 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033904561, 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.217 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9398 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.46e-07 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017682+0000", 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8250000000000001e-06 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017688+0000", 2024-09-14T07:12:04.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4890000000000003e-06 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017692+0000", 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4970000000000003e-06 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051475+0000", 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033782963999999999 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051517+0000", 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2014999999999997e-05 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051584+0000", 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7424999999999999e-05 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9400 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1159168~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.221 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.12990613400000001, 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034021379999999997, 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9400 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1399999999999997e-07 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017700+0000", 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.871e-06 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017705+0000", 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2989999999999996e-06 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017711+0000", 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6389999999999997e-06 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051610+0000", 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033899171999999998 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051651+0000", 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1236999999999998e-05 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051719+0000", 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7748000000000003e-05 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9402 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1200128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.129887629, 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034131720999999997, 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9402 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017717+0000", 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.22e-07 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017718+0000", 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7430000000000001e-06 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017724+0000", 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.57e-06 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017728+0000", 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3000000000000003e-06 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051743+0000", 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034015116999999997 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051783+0000", 2024-09-14T07:12:04.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9904000000000003e-05 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051848+0000", 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4764999999999994e-05 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9404 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1294336~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.12987014999999999, 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034257163, 2024-09-14T07:12:04.230 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9404 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8599999999999999e-07 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017736+0000", 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.826e-06 2024-09-14T07:12:04.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017742+0000", 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017747+0000", 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.259e-06 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051873+0000", 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034125988000000003 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051918+0000", 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5368000000000003e-05 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051991+0000", 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2721999999999999e-05 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9406 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1335296~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.1298511, 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034372278999999999, 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9406 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.235 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4600000000000005e-07 2024-09-14T07:12:04.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017755+0000", 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017761+0000", 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8270000000000003e-06 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017766+0000", 2024-09-14T07:12:04.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7979999999999996e-06 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052015+0000", 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034249479999999999 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052056+0000", 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0311000000000001e-05 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052125+0000", 2024-09-14T07:12:04.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9451999999999998e-05 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9408 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1376256~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.129832753, 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034485301000000003, 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:04.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9408 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:04.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022916+0000", 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051447860000000002 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022920+0000", 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022930+0000", 2024-09-14T07:12:04.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8719999999999997e-06 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022937+0000", 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.922e-06 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052150+0000", 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029213214000000001 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052190+0000", 2024-09-14T07:12:04.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0054e-05 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052256+0000", 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6533999999999997e-05 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:04.243 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:04.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:04.246 INFO:teuthology.orchestra.run.smithi071.stdout:751 write 0x60236e5 thru 0x6025641 (0x1f5d bytes) 2024-09-14T07:12:04.246 INFO:teuthology.orchestra.run.smithi071.stdout:753 writesame 0x1dccecc thru 0x1dda300 data_size 0x35(0xd435 bytes) 2024-09-14T07:12:04.246 INFO:teuthology.orchestra.run.smithi071.stdout:754 write 0xc9b9bac thru 0xc9bb30a (0x175f bytes) 2024-09-14T07:12:04.246 INFO:teuthology.orchestra.run.smithi071.stdout:755 punch from 0x8585230 to 0x858d7c4, (0x8594 bytes) 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:757 write 0x37f1e0d thru 0x37fb9ab (0x9b9f bytes) 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:758 writesame 0xc59748e thru 0xc59ffd7 data_size 0x3f(0x8b4a bytes) 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:759 write 0xa2ef31 thru 0xa33fc4 (0x5094 bytes) 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:760 trunc from 0xc9bb30b to 0x2cb0786 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:761 punch from 0xf8d253 to 0xf95adc, (0x8889 bytes) 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:762 read 0x9b786f thru 0x9bc554 (0x4ce6 bytes) 2024-09-14T07:12:04.247 INFO:teuthology.orchestra.run.smithi071.stdout:763 punch from 0x111268d to 0x111fc81, (0xd5f4 bytes) 2024-09-14T07:12:04.248 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:04.243+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:04.254 INFO:teuthology.orchestra.run.smithi071.stdout:764 trunc from 0x2cb0786 to 0xb4362e4 2024-09-14T07:12:04.259 INFO:teuthology.orchestra.run.smithi071.stdout:766 read 0x13eec20 thru 0x13f6da5 (0x8186 bytes) 2024-09-14T07:12:04.260 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:04.260 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:04.260 INFO:teuthology.orchestra.run.smithi071.stdout:772 read 0x6b838d7 thru 0x6b8fdfa (0xc524 bytes) 2024-09-14T07:12:04.269 INFO:teuthology.orchestra.run.smithi071.stdout:774 trunc from 0xb4362e4 to 0x3e211ad 2024-09-14T07:12:04.286 INFO:teuthology.orchestra.run.smithi071.stdout:776 writesame 0x9179890 thru 0x9182a85 data_size 0x77(0x91f6 bytes) 2024-09-14T07:12:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:779 read 0x5c70c4b thru 0x5c7a4c8 (0x987e bytes) 2024-09-14T07:12:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:781 read 0x25be249 thru 0x25beb65 (0x91d bytes) 2024-09-14T07:12:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:782 read 0x1581d81 thru 0x1589d96 (0x8016 bytes) 2024-09-14T07:12:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:783 punch from 0x5416ecf to 0x54195c1, (0x26f2 bytes) 2024-09-14T07:12:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:784 punch from 0x20a2b27 to 0x20a53d2, (0x28ab bytes) 2024-09-14T07:12:04.294 INFO:teuthology.orchestra.run.smithi071.stdout:786 trunc from 0x9182a86 to 0x3a0d376 2024-09-14T07:12:04.299 INFO:teuthology.orchestra.run.smithi071.stdout:787 writesame 0xdd395d thru 0xddae9b data_size 0x2d(0x753f bytes) 2024-09-14T07:12:04.301 INFO:teuthology.orchestra.run.smithi071.stdout:788 read 0xc2d992 thru 0xc3d4e9 (0xfb58 bytes) 2024-09-14T07:12:04.302 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:04.302 INFO:teuthology.orchestra.run.smithi071.stdout:793 punch from 0x19d4c98 to 0x19e0a80, (0xbde8 bytes) 2024-09-14T07:12:04.306 INFO:teuthology.orchestra.run.smithi071.stdout:796 trunc from 0x3a0d376 to 0x6e63cf 2024-09-14T07:12:04.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:04.317 INFO:teuthology.orchestra.run.smithi071.stdout:797 read 0x4e11d6 thru 0x4ecf14 (0xbd3f bytes) 2024-09-14T07:12:04.318 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:04.339 INFO:teuthology.orchestra.run.smithi071.stdout:799 write 0xb38d657 thru 0xb39a028 (0xc9d2 bytes) 2024-09-14T07:12:04.345 INFO:teuthology.orchestra.run.smithi071.stdout:801 trunc from 0xb39a029 to 0xcfa7317 2024-09-14T07:12:04.345 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:04.344+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:04.350 INFO:teuthology.orchestra.run.smithi071.stdout:802 read 0xbb920d thru 0xbc2e4d (0x9c41 bytes) 2024-09-14T07:12:04.350 INFO:teuthology.orchestra.run.smithi071.stdout:803 write 0xa0ab00d thru 0xa0b1c71 (0x6c65 bytes) 2024-09-14T07:12:04.353 INFO:teuthology.orchestra.run.smithi071.stdout:804 trunc from 0xcfa7317 to 0xb1fd98b 2024-09-14T07:12:04.360 INFO:teuthology.orchestra.run.smithi071.stdout:805 writesame 0x42fc87e thru 0x43078cb data_size 0x1(0xb04e bytes) 2024-09-14T07:12:04.377 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:04.377 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:04.377 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:04.378 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:04.384 INFO:teuthology.orchestra.run.smithi071.stdout:806 read 0x15f5786 thru 0x1602fad (0xd828 bytes) 2024-09-14T07:12:04.385 INFO:teuthology.orchestra.run.smithi071.stdout:807 read 0x7eba765 thru 0x7ec100a (0x68a6 bytes) 2024-09-14T07:12:04.385 INFO:teuthology.orchestra.run.smithi071.stdout:808 writesame 0x4d9b2ba thru 0x4da66f6 data_size 0x1(0xb43d bytes) 2024-09-14T07:12:04.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:04.411 INFO:teuthology.orchestra.run.smithi071.stdout:809 read 0x4f4c11c thru 0x4f4d5d2 (0x14b7 bytes) 2024-09-14T07:12:04.411 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:04.412 INFO:teuthology.orchestra.run.smithi071.stdout:811 read 0x2bd32af thru 0x2bd7d6e (0x4ac0 bytes) 2024-09-14T07:12:04.412 INFO:teuthology.orchestra.run.smithi071.stdout:813 clone 6 order 22 su 262144 sc 6 2024-09-14T07:12:04.446 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:04.446 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:04.446 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:04.445+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:04.463 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:04.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:04.495 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:04.495 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:04.512 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:04.516 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:04.517 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:04.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:04.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:04.530 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:04.546 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:04.546 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:04.546 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:04.546+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:04.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:04.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:04.631 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:04.631 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:04.640 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:04.647 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:04.647+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:04.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:12:04.752 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:04.752 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:04.752 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:04.751+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:04.762 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:04.771 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone5 from 0xb1fd98b (overlap 0x6e63cf) to 0x584fd8 2024-09-14T07:12:04.841 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-14T07:12:04.852 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:04.851+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:04.906 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:04.907 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:04.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:04.949 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:04.949+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:04.954 INFO:teuthology.orchestra.run.smithi071.stdout:814 write 0x61533f9 thru 0x6160db7 (0xd9bf bytes) 2024-09-14T07:12:04.963 INFO:teuthology.orchestra.run.smithi071.stdout:816 read 0x4e44c7 thru 0x4eb652 (0x718c bytes) 2024-09-14T07:12:04.973 INFO:teuthology.orchestra.run.smithi071.stdout:817 trunc from 0xb1fd98b to 0x3ea0f6a 2024-09-14T07:12:05.007 INFO:teuthology.orchestra.run.smithi071.stdout:819 write 0x95dce2a thru 0x95e4df4 (0x7fcb bytes) 2024-09-14T07:12:05.010 INFO:teuthology.orchestra.run.smithi071.stdout:820 read 0x426fc8 thru 0x429510 (0x2549 bytes) 2024-09-14T07:12:05.011 INFO:teuthology.orchestra.run.smithi071.stdout:821 punch from 0x606d257 to 0x60716fb, (0x44a4 bytes) 2024-09-14T07:12:05.017 INFO:teuthology.orchestra.run.smithi071.stdout:822 trunc from 0x95e4df5 to 0xe06aa35 2024-09-14T07:12:05.027 INFO:teuthology.orchestra.run.smithi071.stdout:824 trunc from 0xe06aa35 to 0xaeb9f4b 2024-09-14T07:12:05.033 INFO:teuthology.orchestra.run.smithi071.stdout:826 read 0x4cf8365 thru 0x4cfd34a (0x4fe6 bytes) 2024-09-14T07:12:05.034 INFO:teuthology.orchestra.run.smithi071.stdout:827 read 0x33834e9 thru 0x33908f1 (0xd409 bytes) 2024-09-14T07:12:05.036 INFO:teuthology.orchestra.run.smithi071.stdout:828 trunc from 0xaeb9f4b to 0x94b0362 2024-09-14T07:12:05.043 INFO:teuthology.orchestra.run.smithi071.stdout:829 write 0x295e7c1 thru 0x296d294 (0xead4 bytes) 2024-09-14T07:12:05.050 INFO:teuthology.orchestra.run.smithi071.stdout:830 write 0x3a407a9 thru 0x3a40b67 (0x3bf bytes) 2024-09-14T07:12:05.050 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:05.050+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:05.052 INFO:teuthology.orchestra.run.smithi071.stdout:831 write 0x624e425 thru 0x6252be8 (0x47c4 bytes) 2024-09-14T07:12:05.065 INFO:teuthology.orchestra.run.smithi071.stdout:832 trunc from 0x94b0362 to 0x9c4099 2024-09-14T07:12:05.076 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.076 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:05.125 INFO:teuthology.orchestra.run.smithi071.stdout:833 write 0x7e8d0b4 thru 0x7e8f337 (0x2284 bytes) 2024-09-14T07:12:05.135 INFO:teuthology.orchestra.run.smithi071.stdout:834 trunc from 0x7e8f338 to 0x2dd7c0a 2024-09-14T07:12:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:839 punch from 0x75e8be to 0x75f8a5, (0xfe7 bytes) 2024-09-14T07:12:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:840 punch from 0x1597130 to 0x15a4886, (0xd756 bytes) 2024-09-14T07:12:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:841 read 0x130e039 thru 0x131a96e (0xc936 bytes) 2024-09-14T07:12:05.145 INFO:teuthology.orchestra.run.smithi071.stdout:844 write 0x3bc9d2 thru 0x3c3f23 (0x7552 bytes) 2024-09-14T07:12:05.151 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:05.150+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:05.162 INFO:teuthology.orchestra.run.smithi071.stdout:845 writesame 0xb7fb41b thru 0xb7fdb92 data_size 0xc(0x2778 bytes) 2024-09-14T07:12:05.163 INFO:teuthology.orchestra.run.smithi071.stdout:846 write 0x5f0e8f1 thru 0x5f137cc (0x4edc bytes) 2024-09-14T07:12:05.165 INFO:teuthology.orchestra.run.smithi071.stdout:847 write 0x3f7d8df thru 0x3f88172 (0xa894 bytes) 2024-09-14T07:12:05.174 INFO:teuthology.orchestra.run.smithi071.stdout:853 trunc from 0xb7fdb93 to 0xa768bd2 2024-09-14T07:12:05.179 INFO:teuthology.orchestra.run.smithi071.stdout:855 writesame 0x995d8fc thru 0x995ea1b data_size 0x10(0x1120 bytes) 2024-09-14T07:12:05.183 INFO:teuthology.orchestra.run.smithi071.stdout:858 writesame 0x5cd0e5e thru 0x5cd3226 data_size 0x1(0x23c9 bytes) 2024-09-14T07:12:05.204 INFO:teuthology.orchestra.run.smithi071.stdout:859 trunc from 0xa768bd2 to 0x2a07e1e 2024-09-14T07:12:05.225 INFO:teuthology.orchestra.run.smithi071.stdout:860 read 0xbc46f2 thru 0xbc69a0 (0x22af bytes) 2024-09-14T07:12:05.225 INFO:teuthology.orchestra.run.smithi071.stdout:861 punch from 0x206bcf to 0x20978a, (0x2bbb bytes) 2024-09-14T07:12:05.225 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.233 INFO:teuthology.orchestra.run.smithi071.stdout:864 write 0x496c839 thru 0x4970266 (0x3a2e bytes) 2024-09-14T07:12:05.241 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.242 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.252 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:05.251+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:05.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:05.256 INFO:teuthology.orchestra.run.smithi071.stdout:865 write 0xa063933 thru 0xa06d6d5 (0x9da3 bytes) 2024-09-14T07:12:05.263 INFO:teuthology.orchestra.run.smithi071.stdout:866 writesame 0xc6b71fb thru 0xc6c160f data_size 0x1f(0xa415 bytes) 2024-09-14T07:12:05.264 INFO:teuthology.orchestra.run.smithi071.stdout:867 write 0x634647c thru 0x6348612 (0x2197 bytes) 2024-09-14T07:12:05.274 INFO:teuthology.orchestra.run.smithi071.stdout:868 trunc from 0xc6c1610 to 0x6c8ae62 2024-09-14T07:12:05.293 INFO:teuthology.orchestra.run.smithi071.stdout:870 write 0x9f8f73e thru 0x9f95307 (0x5bca bytes) 2024-09-14T07:12:05.303 INFO:teuthology.orchestra.run.smithi071.stdout:871 write 0xb9808ef thru 0xb9814dc (0xbee bytes) 2024-09-14T07:12:05.306 INFO:teuthology.orchestra.run.smithi071.stdout:874 write 0x8718b38 thru 0x871aaf2 (0x1fbb bytes) 2024-09-14T07:12:05.308 INFO:teuthology.orchestra.run.smithi071.stdout:875 write 0x9c84925 thru 0x9c8de40 (0x951c bytes) 2024-09-14T07:12:05.317 INFO:teuthology.orchestra.run.smithi071.stdout:876 trunc from 0xb9814dd to 0x5157d57 2024-09-14T07:12:05.331 INFO:teuthology.orchestra.run.smithi071.stdout:877 read 0x40e0a93 thru 0x40e34f8 (0x2a66 bytes) 2024-09-14T07:12:05.339 INFO:teuthology.orchestra.run.smithi071.stdout:880 writesame 0x7c48f70 thru 0x7c4ed69 data_size 0x17(0x5dfa bytes) 2024-09-14T07:12:05.339 INFO:teuthology.orchestra.run.smithi071.stdout:881 read 0x71fe7a8 thru 0x7207f36 (0x978f bytes) 2024-09-14T07:12:05.340 INFO:teuthology.orchestra.run.smithi071.stdout:882 write 0x19d14a6 thru 0x19d7586 (0x60e1 bytes) 2024-09-14T07:12:05.342 INFO:teuthology.orchestra.run.smithi071.stdout:884 read 0x1a1966b thru 0x1a25e6c (0xc802 bytes) 2024-09-14T07:12:05.347 INFO:teuthology.orchestra.run.smithi071.stdout:885 trunc from 0x7c4ed6a to 0xb6732df 2024-09-14T07:12:05.353 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:05.352+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:05.359 INFO:teuthology.orchestra.run.smithi071.stdout:886 writesame 0xd758afb thru 0xd768833 data_size 0x5(0xfd39 bytes) 2024-09-14T07:12:05.359 INFO:teuthology.orchestra.run.smithi071.stdout:887 writesame 0x2ec6c81 thru 0x2ed4d00 data_size 0x40(0xe080 bytes) 2024-09-14T07:12:05.360 INFO:teuthology.orchestra.run.smithi071.stdout:889 read 0x8bf3971 thru 0x8c02014 (0xe6a4 bytes) 2024-09-14T07:12:05.361 INFO:teuthology.orchestra.run.smithi071.stdout:890 read 0x1f8e427 thru 0x1f9db1e (0xf6f8 bytes) 2024-09-14T07:12:05.361 INFO:teuthology.orchestra.run.smithi071.stdout:892 write 0x105fe75 thru 0x106d324 (0xd4b0 bytes) 2024-09-14T07:12:05.362 INFO:teuthology.orchestra.run.smithi071.stdout:893 writesame 0xbaca05e thru 0xbad3ccc data_size 0x7(0x9c6f bytes) 2024-09-14T07:12:05.369 INFO:teuthology.orchestra.run.smithi071.stdout:894 write 0x7cc619b thru 0x7cc7564 (0x13ca bytes) 2024-09-14T07:12:05.374 INFO:teuthology.orchestra.run.smithi071.stdout:895 write 0xb7e0f8 thru 0xb87859 (0x9762 bytes) 2024-09-14T07:12:05.375 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.375 INFO:teuthology.orchestra.run.smithi071.stdout:897 read 0xc1dbe19 thru 0xc1e3a03 (0x7beb bytes) 2024-09-14T07:12:05.375 INFO:teuthology.orchestra.run.smithi071.stdout:898 writesame 0x2bb23ae thru 0x2bbbbd8 data_size 0x35(0x982b bytes) 2024-09-14T07:12:05.380 INFO:teuthology.orchestra.run.smithi071.stdout:899 write 0xcb7556a thru 0xcb7a728 (0x51bf bytes) 2024-09-14T07:12:05.381 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.381 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.384 INFO:teuthology.orchestra.run.smithi071.stdout:900 write 0x5efc956 thru 0x5f011c2 (0x486d bytes) 2024-09-14T07:12:05.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:05.393 INFO:teuthology.orchestra.run.smithi071.stdout:901 read 0xabca567 thru 0xabd1676 (0x7110 bytes) 2024-09-14T07:12:05.393 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.398 INFO:teuthology.orchestra.run.smithi071.stdout:907 trunc from 0xd768834 to 0x9d698bf 2024-09-14T07:12:05.413 INFO:teuthology.orchestra.run.smithi071.stdout:910 trunc from 0x9d698bf to 0x9e7d85e 2024-09-14T07:12:05.426 INFO:teuthology.orchestra.run.smithi071.stdout:911 write 0xc03fdeb thru 0xc0493a4 (0x95ba bytes) 2024-09-14T07:12:05.437 INFO:teuthology.orchestra.run.smithi071.stdout:912 writesame 0xd82c470 thru 0xd82dfb6 data_size 0x1(0x1b47 bytes) 2024-09-14T07:12:05.438 INFO:teuthology.orchestra.run.smithi071.stdout:913 punch from 0x74d3d7e to 0x74e04e6, (0xc768 bytes) 2024-09-14T07:12:05.438 INFO:teuthology.orchestra.run.smithi071.stdout:915 read 0xfdabfa thru 0xfe7f9b (0xd3a2 bytes) 2024-09-14T07:12:05.442 INFO:teuthology.orchestra.run.smithi071.stdout:916 trunc from 0xd82dfb7 to 0xa49ccfa 2024-09-14T07:12:05.453 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:05.452+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:922 punch from 0x6fc40ae to 0x6fc5d18, (0x1c6a bytes) 2024-09-14T07:12:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:924 read 0x8c67f8b thru 0x8c681a2 (0x218 bytes) 2024-09-14T07:12:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:925 read 0x261bc4c thru 0x2629e20 (0xe1d5 bytes) 2024-09-14T07:12:05.455 INFO:teuthology.orchestra.run.smithi071.stdout:928 read 0x1a506ff thru 0x1a5635d (0x5c5f bytes) 2024-09-14T07:12:05.459 INFO:teuthology.orchestra.run.smithi071.stdout:929 trunc from 0xa49ccfa to 0x6568c5d 2024-09-14T07:12:05.471 INFO:teuthology.orchestra.run.smithi071.stdout:930 trunc from 0x6568c5d to 0x5f0988d 2024-09-14T07:12:05.482 INFO:teuthology.orchestra.run.smithi071.stdout:932 read 0x4480527 thru 0x4487245 (0x6d1f bytes) 2024-09-14T07:12:05.495 INFO:teuthology.orchestra.run.smithi071.stdout:933 write 0xc5bd804 thru 0xc5c7c71 (0xa46e bytes) 2024-09-14T07:12:05.502 INFO:teuthology.orchestra.run.smithi071.stdout:934 write 0x13d5f25 thru 0x13e4048 (0xe124 bytes) 2024-09-14T07:12:05.503 INFO:teuthology.orchestra.run.smithi071.stdout:935 writesame 0x25600a3 thru 0x256ef3e data_size 0x2(0xee9c bytes) 2024-09-14T07:12:05.515 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.515 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.519 INFO:teuthology.orchestra.run.smithi071.stdout:936 read 0xa256f4 thru 0xa33f64 (0xe871 bytes) 2024-09-14T07:12:05.520 INFO:teuthology.orchestra.run.smithi071.stdout:937 write 0x156d38e thru 0x1574225 (0x6e98 bytes) 2024-09-14T07:12:05.521 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.521 INFO:teuthology.orchestra.run.smithi071.stdout:939 writesame 0x5433a51 thru 0x5438122 data_size 0x31(0x46d2 bytes) 2024-09-14T07:12:05.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:05.525 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.536 INFO:teuthology.orchestra.run.smithi071.stdout:941 trunc from 0xc5c7c72 to 0x244ffc4 2024-09-14T07:12:05.566 INFO:teuthology.orchestra.run.smithi071.stdout:944 trunc from 0x244ffc4 to 0xd084683 2024-09-14T07:12:05.566 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:05.565+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:05.571 INFO:teuthology.orchestra.run.smithi071.stdout:945 read 0x78f4500 thru 0x78fc9d7 (0x84d8 bytes) 2024-09-14T07:12:05.578 INFO:teuthology.orchestra.run.smithi071.stdout:946 write 0xe959aa8 thru 0xe95b319 (0x1872 bytes) 2024-09-14T07:12:05.599 INFO:teuthology.orchestra.run.smithi071.stdout:947 trunc from 0xe95b31a to 0xd64e39 2024-09-14T07:12:05.626 INFO:teuthology.orchestra.run.smithi071.stdout:948 write 0x156fec4 thru 0x1570ed2 (0x100f bytes) 2024-09-14T07:12:05.627 INFO:teuthology.orchestra.run.smithi071.stdout:949 write 0xf77454 thru 0xf844ef (0xd09c bytes) 2024-09-14T07:12:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:950 read 0x7fca95 thru 0x8022f3 (0x585f bytes) 2024-09-14T07:12:05.644 INFO:teuthology.orchestra.run.smithi071.stdout:951 trunc from 0x1570ed3 to 0xe3e3f4d 2024-09-14T07:12:05.649 INFO:teuthology.orchestra.run.smithi071.stdout:952 read 0x396d936 thru 0x3970813 (0x2ede bytes) 2024-09-14T07:12:05.650 INFO:teuthology.orchestra.run.smithi071.stdout:953 read 0x770f953 thru 0x77125d4 (0x2c82 bytes) 2024-09-14T07:12:05.653 INFO:teuthology.orchestra.run.smithi071.stdout:954 trunc from 0xe3e3f4d to 0xb6cbff3 2024-09-14T07:12:05.655 INFO:teuthology.orchestra.run.smithi086.stdout: marking collection for removal 2024-09-14T07:12:05.655 INFO:teuthology.orchestra.run.smithi086.stdout:setting '_remove' omap key 2024-09-14T07:12:05.655 INFO:teuthology.orchestra.run.smithi086.stdout:finish_remove_pgs 3.c_head removing 3.c 2024-09-14T07:12:05.656 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:05.654+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:05.656 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.656 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.658 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.658 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.658 INFO:teuthology.orchestra.run.smithi071.stdout:958 punch from 0x150567f to 0x150dc18, (0x8599 bytes) 2024-09-14T07:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:959 read 0xbca8ee thru 0xbd50bd (0xa7d0 bytes) 2024-09-14T07:12:05.659 INFO:teuthology.orchestra.run.smithi086.stdout:Remove successful 2024-09-14T07:12:05.665 INFO:teuthology.orchestra.run.smithi071.stdout:960 trunc from 0xb6cbff3 to 0x6117e13 2024-09-14T07:12:05.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:05.670 INFO:teuthology.orchestra.run.smithi071.stdout:961 write 0x181ac84 thru 0x182293c (0x7cb9 bytes) 2024-09-14T07:12:05.673 INFO:teuthology.orchestra.run.smithi071.stdout:962 read 0x55a002a thru 0x55aa5b3 (0xa58a bytes) 2024-09-14T07:12:05.673 INFO:teuthology.orchestra.run.smithi071.stdout:964 punch from 0x564fcb6 to 0x5655d37, (0x6081 bytes) 2024-09-14T07:12:05.673 INFO:teuthology.orchestra.run.smithi071.stdout:965 write 0x1ba8106 thru 0x1bb4800 (0xc6fb bytes) 2024-09-14T07:12:05.675 INFO:teuthology.orchestra.run.smithi071.stdout:967 write 0x25bd1b8 thru 0x25c4395 (0x71de bytes) 2024-09-14T07:12:05.680 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.680 INFO:teuthology.orchestra.run.smithi071.stdout:970 read 0x302c1c6 thru 0x3037b06 (0xb941 bytes) 2024-09-14T07:12:05.680 INFO:teuthology.orchestra.run.smithi071.stdout:972 write 0x36a8b59 thru 0x36aa31a (0x17c2 bytes) 2024-09-14T07:12:05.683 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.683 INFO:teuthology.orchestra.run.smithi071.stdout:976 read 0xd2b1f3 thru 0xd2dfe7 (0x2df5 bytes) 2024-09-14T07:12:05.692 INFO:teuthology.orchestra.run.smithi071.stdout:977 write 0x92552f7 thru 0x9259f08 (0x4c12 bytes) 2024-09-14T07:12:05.698 INFO:teuthology.orchestra.run.smithi071.stdout:979 writesame 0x5d77d55 thru 0x5d87a1d data_size 0x21(0xfcc9 bytes) 2024-09-14T07:12:05.707 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:12:05.711 INFO:teuthology.orchestra.run.smithi071.stdout:983 trunc from 0x9259f09 to 0x33ba53a 2024-09-14T07:12:05.731 INFO:teuthology.orchestra.run.smithi071.stdout:984 write 0x38aa240 thru 0x38ab66c (0x142d bytes) 2024-09-14T07:12:05.751 INFO:teuthology.orchestra.run.smithi071.stdout:985 writesame 0xbb74e92 thru 0xbb7cca2 data_size 0x1(0x7e11 bytes) 2024-09-14T07:12:05.751 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.756 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:05.755+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:05.760 INFO:teuthology.orchestra.run.smithi071.stdout:988 write 0xecedaa0 thru 0xecf0601 (0x2b62 bytes) 2024-09-14T07:12:05.763 INFO:teuthology.orchestra.run.smithi071.stdout:989 writesame 0x13e4427 thru 0x13f1340 data_size 0x31(0xcf1a bytes) 2024-09-14T07:12:05.764 INFO:teuthology.orchestra.run.smithi071.stdout:990 write 0xbe8fecc thru 0xbe905de (0x713 bytes) 2024-09-14T07:12:05.770 INFO:teuthology.orchestra.run.smithi071.stdout:992 read 0x11f270a thru 0x11f7d5d (0x5654 bytes) 2024-09-14T07:12:05.770 INFO:teuthology.orchestra.run.smithi071.stdout:993 writesame 0x1b86253 thru 0x1b8f7e7 data_size 0x1(0x9595 bytes) 2024-09-14T07:12:05.784 INFO:teuthology.orchestra.run.smithi071.stdout:994 read 0x1f61269 thru 0x1f6578d (0x4525 bytes) 2024-09-14T07:12:05.785 INFO:teuthology.orchestra.run.smithi071.stdout:997 punch from 0x9eb912b to 0x9ec2c4d, (0x9b22 bytes) 2024-09-14T07:12:05.787 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.787 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.793 INFO:teuthology.orchestra.run.smithi071.stdout:998 trunc from 0xecf0602 to 0x7a1ead3 2024-09-14T07:12:05.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:05.807 INFO:teuthology.orchestra.run.smithi071.stdout:999 trunc from 0x7a1ead3 to 0x932b634 2024-09-14T07:12:05.823 INFO:teuthology.orchestra.run.smithi071.stdout:1000 writesame 0xde0c7bb thru 0xde170e1 data_size 0x1(0xa927 bytes) 2024-09-14T07:12:05.824 INFO:teuthology.orchestra.run.smithi071.stdout:1001 read 0x5d9adf9 thru 0x5da8caf (0xdeb7 bytes) 2024-09-14T07:12:05.835 INFO:teuthology.orchestra.run.smithi071.stdout:1002 trunc from 0xde170e2 to 0x3df96d7 2024-09-14T07:12:05.842 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:05.842 INFO:teuthology.orchestra.run.smithi071.stdout:1005 write 0x374e320 thru 0x3759eae (0xbb8f bytes) 2024-09-14T07:12:05.849 INFO:teuthology.orchestra.run.smithi071.stdout:1006 trunc from 0x3df96d7 to 0x65a2a8f 2024-09-14T07:12:05.856 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:05.856+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:05.862 INFO:teuthology.orchestra.run.smithi071.stdout:1008 write 0x8b31bf6 thru 0x8b3f036 (0xd441 bytes) 2024-09-14T07:12:05.865 INFO:teuthology.orchestra.run.smithi071.stdout:1011 read 0x60e1d27 thru 0x60eb438 (0x9712 bytes) 2024-09-14T07:12:05.871 INFO:teuthology.orchestra.run.smithi071.stdout:1012 trunc from 0x8b3f037 to 0x3f3db5d 2024-09-14T07:12:05.885 INFO:teuthology.orchestra.run.smithi071.stdout:1013 trunc from 0x3f3db5d to 0x608846c 2024-09-14T07:12:05.893 INFO:teuthology.orchestra.run.smithi071.stdout:1014 writesame 0x4332fdb thru 0x4340803 data_size 0x1(0xd829 bytes) 2024-09-14T07:12:05.920 INFO:teuthology.orchestra.run.smithi071.stdout:1015 clone 7 order 19 su 131072 sc 11 2024-09-14T07:12:05.923 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:05.924 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:05.932 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:05.974 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:05.973+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:06.036 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:06.036 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:06.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:06.089 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:06.088+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:06.148 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:06.148 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:06.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:06.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.c.5 2024-09-14T07:12:06.180 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:06.177+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:06.264 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:06.263+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:06.324 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:06.324 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:06.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:06.374 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:06.373+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:06.461 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:06.460+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:06.476 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:06.476 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:06.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:06.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:06.569 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:06.568+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:06.629 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:06.629 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:06.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:06.674 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:06.674 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:06.678 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:06.677+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:06.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:06.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:06.706 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:06.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:06.725 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:06.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:06.744 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:06.745 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:06.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:06.763 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:06.762+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:06.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:06.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:06.783 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:06.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:06.787 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:06.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:955 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.6885619219999999, 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049726400000000004, 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 955 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096854+0000", 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7800000000000002e-07 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096857+0000", 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5500000000000001e-06 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096863+0000", 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8069999999999996e-06 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096867+0000", 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7190000000000001e-06 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.099471+0000", 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026034069999999999 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.099524+0000", 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2979000000000002e-05 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.099755+0000", 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023132400000000001 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101388+0000", 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001632887 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101734+0000", 2024-09-14T07:12:06.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034561800000000001 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101784+0000", 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0333000000000001e-05 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101827+0000", 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2638000000000001e-05 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:956 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.096874+0000", 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.6885416769999999, 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064521819999999999, 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 956 2024-09-14T07:12:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096874+0000", 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096874+0000", 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096875+0000", 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4499999999999997e-07 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096878+0000", 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4589999999999998e-06 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096884+0000", 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1430000000000003e-06 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.096895+0000", 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0522e-05 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.100543+0000", 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036484640000000001 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.100623+0000", 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9264999999999994e-05 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.101014+0000", 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039168699999999999 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.102551+0000", 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015364479999999999 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.103273+0000", 2024-09-14T07:12:06.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072191900000000001 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.103299+0000", 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6656e-05 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.103326+0000", 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7174000000000001e-05 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:978 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.122352+0000", 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.6630642439999992, 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043801029999999998, 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 978 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.800 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122352+0000", 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122352+0000", 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122354+0000", 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0600000000000002e-06 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122371+0000", 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.774e-05 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122382+0000", 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0156000000000001e-05 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122386+0000", 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7260000000000002e-06 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122462+0000", 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5841999999999997e-05 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122514+0000", 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1725999999999999e-05 2024-09-14T07:12:06.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.122655+0000", 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014141100000000001 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.123214+0000", 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055832699999999996 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.126673+0000", 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003459564 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.126705+0000", 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2203000000000003e-05 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.126732+0000", 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6347999999999999e-05 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1267 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.751991+0000", 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0334247639999994, 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064042830000000002, 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1267 2024-09-14T07:12:06.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751991+0000", 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751991+0000", 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751992+0000", 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4499999999999997e-07 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.751998+0000", 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.037e-06 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752006+0000", 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0669999999999992e-06 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.752012+0000", 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.835e-06 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754875+0000", 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028632430000000001 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754967+0000", 2024-09-14T07:12:06.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2492999999999997e-05 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.755326+0000", 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000358105 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757633+0000", 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023071609999999998 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758294+0000", 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066165799999999997 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758355+0000", 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0837e-05 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758395+0000", 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0302000000000001e-05 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1277 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.753269+0000", 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0321468960000004, 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059202710000000004, 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1277 2024-09-14T07:12:06.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753269+0000", 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753269+0000", 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753270+0000", 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.61e-07 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753275+0000", 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3260000000000003e-06 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753282+0000", 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3520000000000001e-06 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753287+0000", 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6920000000000001e-06 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756243+0000", 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029560739999999999 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756297+0000", 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4103e-05 2024-09-14T07:12:06.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756603+0000", 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030542399999999999 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758402+0000", 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001799695 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759094+0000", 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069117600000000005 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759149+0000", 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5859000000000002e-05 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759189+0000", 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9909e-05 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1279 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.031995277, 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058589460000000003, 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1279 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753421+0000", 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3399999999999999e-07 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753425+0000", 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.495e-06 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753433+0000", 2024-09-14T07:12:06.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8299999999999996e-06 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753440+0000", 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9670000000000004e-06 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756961+0000", 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035209199999999999 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757034+0000", 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3098999999999999e-05 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757278+0000", 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024468599999999998 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759042+0000", 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00176337 2024-09-14T07:12:06.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759230+0000", 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018805100000000001 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759256+0000", 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6325e-05 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759280+0000", 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3569000000000001e-05 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.823 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1281 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.753668+0000", 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0317480620000001, 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0064311359999999996, 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.824 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1281 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753668+0000", 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753668+0000", 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753669+0000", 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8400000000000003e-07 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753673+0000", 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.031e-06 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753680+0000", 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6510000000000001e-06 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.753685+0000", 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7029999999999997e-06 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757686+0000", 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040011150000000004 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.757766+0000", 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0121000000000001e-05 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758020+0000", 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418100000000002 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759288+0000", 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012676829999999999 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760016+0000", 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000727365 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760071+0000", 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5685e-05 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760099+0000", 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7817000000000002e-05 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1283 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0313882260000007, 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069480920000000003, 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1283 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754028+0000", 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6199999999999997e-07 2024-09-14T07:12:06.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754032+0000", 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5200000000000002e-06 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754039+0000", 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9779999999999999e-06 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.754043+0000", 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4309999999999996e-06 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758424+0000", 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004380803 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758506+0000", 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2081000000000002e-05 2024-09-14T07:12:06.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.758787+0000", 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028124999999999998 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759977+0000", 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001189474 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760881+0000", 2024-09-14T07:12:06.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00090457199999999997 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760940+0000", 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8041999999999998e-05 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760976+0000", 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6279000000000003e-05 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1288 3.10 3:0cdfd714:::rbd_object_map.11822ba09815:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.756918+0000", 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.0284977479999995, 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047051740000000003, 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1288 2024-09-14T07:12:06.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756918+0000", 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756918+0000", 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756919+0000", 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0279999999999999e-06 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756924+0000", 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8550000000000001e-06 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756931+0000", 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0029999999999997e-06 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.756936+0000", 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9280000000000001e-06 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759317+0000", 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002381387 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759401+0000", 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3236000000000001e-05 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.759689+0000", 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028833 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.760290+0000", 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000600561 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.761534+0000", 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012445170000000001 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.761584+0000", 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0019999999999999e-05 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.761623+0000", 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9308999999999999e-05 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:1753 3.a 3:54733f3e:::rbd_data.1182823d0fd0.000000000000004e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:58.968631+0000", 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.8167847120000005, 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050848289999999999, 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1753 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968631+0000", 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968631+0000", 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968632+0000", 2024-09-14T07:12:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4000000000000001e-07 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968639+0000", 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9979999999999997e-06 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968654+0000", 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5058000000000001e-05 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.968663+0000", 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9420000000000001e-06 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969059+0000", 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00039654099999999998 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969132+0000", 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2762999999999994e-05 2024-09-14T07:12:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.969231+0000", 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8504000000000004e-05 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973409+0000", 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041781270000000002 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973606+0000", 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196978 2024-09-14T07:12:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973676+0000", 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0494999999999995e-05 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:58.973716+0000", 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9783000000000002e-05 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2210 3.a 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.367851+0000", 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.4175645689999996, 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01116641, 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2210 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367851+0000", 2024-09-14T07:12:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367851+0000", 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367853+0000", 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7850000000000001e-06 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367863+0000", 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5319999999999995e-06 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367879+0000", 2024-09-14T07:12:06.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858e-05 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367886+0000", 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0450000000000003e-06 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.367944+0000", 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8585000000000002e-05 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.368040+0000", 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5595999999999997e-05 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.369684+0000", 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001644284 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378898+0000", 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0092138959999999992 2024-09-14T07:12:06.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378913+0000", 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4594e-05 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.378965+0000", 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2830000000000001e-05 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.379018+0000", 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2404999999999997e-05 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2215 3.a 3:570d4ee3:::rbd_data.1182823d0fd0.000000000000005c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391603+0000", 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.3938129459999997, 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080817279999999998, 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2215 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391603+0000", 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391603+0000", 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391604+0000", 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5030000000000001e-06 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391611+0000", 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4500000000000001e-06 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391626+0000", 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5475999999999999e-05 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391638+0000", 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.147e-05 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391702+0000", 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3740999999999998e-05 2024-09-14T07:12:06.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391787+0000", 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5054000000000003e-05 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391898+0000", 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110998 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.397808+0000", 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059105540000000002 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399624+0000", 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00181616 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399657+0000", 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3071000000000002e-05 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399685+0000", 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7251e-05 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:2212 3.1e e29/23 3:7dba856b:::rbd_data.1182823d0fd0.0000000000000022:head v 29'6, mlcod=29'4)", 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.391980+0000", 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 7.3934358529999997, 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0074371309999999996, 2024-09-14T07:12:06.863 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391980+0000", 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391980+0000", 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391981+0000", 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0800000000000004e-07 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391988+0000", 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9290000000000001e-06 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.391998+0000", 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0553999999999999e-05 2024-09-14T07:12:06.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392005+0000", 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.759e-06 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392059+0000", 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4187000000000001e-05 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.392079+0000", 2024-09-14T07:12:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9930999999999999e-05 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399373+0000", 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007294015 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.399417+0000", 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3948e-05 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7865 3.10 3:09e2e6bf:::rbd_data.1182a7d91484.0000000000000023:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.759712+0000", 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.0257040320000002, 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052471330000000002, 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7865 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759712+0000", 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759712+0000", 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759714+0000", 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7680000000000001e-06 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759720+0000", 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.409e-06 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759739+0000", 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9309000000000001e-05 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759748+0000", 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0799999999999995e-06 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759818+0000", 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9115999999999994e-05 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.759912+0000", 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4041000000000003e-05 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.760090+0000", 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017869399999999999 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.761507+0000", 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014165829999999999 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.764897+0000", 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033901349999999998 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.764931+0000", 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4245000000000002e-05 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.764959+0000", 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7753e-05 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.873 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7880 3.10 3:089b651e:::rbd_data.1182a7d91484.0000000000000047:head [delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.768155+0000", 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.0172609960000001, 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042981110000000003, 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7880 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768155+0000", 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768155+0000", 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768157+0000", 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5910000000000001e-06 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768171+0000", 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4538e-05 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768187+0000", 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5849e-05 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768196+0000", 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9609999999999994e-06 2024-09-14T07:12:06.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768258+0000", 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1748999999999994e-05 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768330+0000", 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2606000000000002e-05 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:06.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.768432+0000", 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101321 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.769093+0000", 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066151399999999998 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.772389+0000", 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032963860000000001 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.772424+0000", 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4245000000000002e-05 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.772453+0000", 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9351000000000001e-05 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9449 3.a 3:56e24ad3:::rbd_data.1182b13d849f.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18850559~65145] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:06.879 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.7173462900000001, 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039129075999999999, 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9449 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068072+0000", 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1220000000000002e-06 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082261+0000", 2024-09-14T07:12:06.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014189286000000001 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082289+0000", 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8123000000000002e-05 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082307+0000", 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7864e-05 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082406+0000", 2024-09-14T07:12:06.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9223999999999997e-05 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082564+0000", 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015800499999999999 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083260+0000", 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069602200000000003 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106367+0000", 2024-09-14T07:12:06.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023106318000000001 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107084+0000", 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000717036 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107149+0000", 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5581999999999997e-05 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107199+0000", 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9493999999999997e-05 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9652 3.a 3:54c0685c:::rbd_data.1182b13d849f.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.422963948, 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021904389, 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9652 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:06.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362454+0000", 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6050000000000001e-06 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362461+0000", 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5769999999999996e-06 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362477+0000", 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5468000000000002e-05 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362484+0000", 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8650000000000003e-06 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362541+0000", 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7172000000000001e-05 2024-09-14T07:12:06.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362617+0000", 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6720999999999999e-05 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.366104+0000", 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003486627 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384214+0000", 2024-09-14T07:12:06.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018109912999999998 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384267+0000", 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3557000000000002e-05 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384303+0000", 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5340999999999999e-05 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384356+0000", 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3542999999999999e-05 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:9652 3.a e34/23 ondisk, result = 0)", 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.377223+0000", 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.408192976, 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071423149999999998, 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.377223+0000", 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.377223+0000", 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.377224+0000", 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.54e-07 2024-09-14T07:12:06.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.377227+0000", 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3050000000000001e-06 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.377238+0000", 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1029999999999999e-05 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.377244+0000", 2024-09-14T07:12:06.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384257+0000", 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0070137350000000001 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384264+0000", 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7569999999999998e-06 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384365+0000", 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101282 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9655 3.a 3:509dad81:::rbd_data.1182b13d849f.0000000000000003:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.3959582560000001, 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021682784, 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:06.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9655 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389459+0000", 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389463+0000", 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.578e-06 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389473+0000", 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8409999999999995e-06 2024-09-14T07:12:06.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389481+0000", 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0970000000000006e-06 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389525+0000", 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4202999999999997e-05 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389568+0000", 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3256000000000001e-05 2024-09-14T07:12:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.392432+0000", 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028639249999999998 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411020+0000", 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018587139999999999 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411037+0000", 2024-09-14T07:12:06.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7706e-05 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411090+0000", 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3100999999999999e-05 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411140+0000", 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0105999999999998e-05 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:9655 3.a e34/23 ondisk, result = 0)", 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.404296+0000", 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.3811200810000002, 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0067335529999999998, 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.404296+0000", 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.404296+0000", 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.404297+0000", 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6000000000000003e-07 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:06.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.404300+0000", 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.021e-06 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.404310+0000", 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0577999999999999e-05 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.404334+0000", 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3464000000000001e-05 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.410999+0000", 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0066656809999999997 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411008+0000", 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9330000000000007e-06 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411029+0000", 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1216000000000002e-05 2024-09-14T07:12:06.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:06.905 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:06.905 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:06.906 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone6 from 0x608846c (overlap 0x9c4099) to 0x8ca089 2024-09-14T07:12:06.906 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-14T07:12:06.906 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:06.905+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:06.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:06.909 INFO:teuthology.orchestra.run.smithi071.stdout:1016 write 0x2132aa0 thru 0x213cb90 (0xa0f1 bytes) 2024-09-14T07:12:06.919 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:06.925 INFO:teuthology.orchestra.run.smithi071.stdout:1019 trunc from 0x608846c to 0x14a77c5 2024-09-14T07:12:06.978 INFO:teuthology.orchestra.run.smithi071.stdout:1021 write 0xdc91539 thru 0xdca140e (0xfed6 bytes) 2024-09-14T07:12:06.982 INFO:teuthology.orchestra.run.smithi071.stdout:1022 write 0x88e823d thru 0x88f43d0 (0xc194 bytes) 2024-09-14T07:12:06.986 INFO:teuthology.orchestra.run.smithi071.stdout:1023 write 0x9acbb28 thru 0x9acfbd3 (0x40ac bytes) 2024-09-14T07:12:06.989 INFO:teuthology.orchestra.run.smithi071.stdout:1024 write 0xbfa3fb6 thru 0xbfb24ad (0xe4f8 bytes) 2024-09-14T07:12:06.992 INFO:teuthology.orchestra.run.smithi071.stdout:1026 read 0x62edabe thru 0x62eed00 (0x1243 bytes) 2024-09-14T07:12:06.992 INFO:teuthology.orchestra.run.smithi071.stdout:1027 write 0xb203d9a thru 0xb2048da (0xb41 bytes) 2024-09-14T07:12:06.995 INFO:teuthology.orchestra.run.smithi071.stdout:1028 read 0x7be4b0b thru 0x7be6dfc (0x22f2 bytes) 2024-09-14T07:12:07.000 INFO:teuthology.orchestra.run.smithi071.stdout:1029 trunc from 0xdca140f to 0x961d205 2024-09-14T07:12:07.007 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:07.006+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:07.022 INFO:teuthology.orchestra.run.smithi071.stdout:1031 write 0xeca0f63 thru 0xeca587c (0x491a bytes) 2024-09-14T07:12:07.025 INFO:teuthology.orchestra.run.smithi071.stdout:1032 writesame 0x741fee2 thru 0x742b879 data_size 0x4(0xb998 bytes) 2024-09-14T07:12:07.031 INFO:teuthology.orchestra.run.smithi071.stdout:1033 punch from 0xb53e9e9 to 0xb54d9de, (0xeff5 bytes) 2024-09-14T07:12:07.031 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:07.031 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:07.031 INFO:teuthology.orchestra.run.smithi071.stdout:1038 write 0xd154228 thru 0xd1622e1 (0xe0ba bytes) 2024-09-14T07:12:07.045 INFO:teuthology.orchestra.run.smithi071.stdout:1040 trunc from 0xeca587d to 0x60999f2 2024-09-14T07:12:07.058 INFO:teuthology.orchestra.run.smithi071.stdout:1041 read 0x17ebf0d thru 0x17ee54b (0x263f bytes) 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:12463 3.15 3:a8863cb6:::rbd_object_map.1182a59bd9ad:head [call lock.assert_locked in=44b,call rbd.object_map_resize in=29b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:07.060045+0000", 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00086863900000000004, 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00088525400000000003, 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "waiting for sub ops", 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 12463 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060045+0000", 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060045+0000", 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060046+0000", 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6300000000000004e-07 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060050+0000", 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4390000000000002e-06 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060063+0000", 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2724999999999999e-05 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060071+0000", 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2549999999999997e-06 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060119+0000", 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8154e-05 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060170+0000", 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0563999999999999e-05 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060306+0000", 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013608500000000001 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:07.060752+0000", 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044607799999999998 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.065 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-14T07:12:07.066 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-14T07:12:07.066 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:07.066 INFO:teuthology.orchestra.run.smithi071.stdout:1042 write 0x6dafc6f thru 0x6dbccd9 (0xd06b bytes) 2024-09-14T07:12:07.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:07.078 INFO:teuthology.orchestra.run.smithi071.stdout:1043 trunc from 0x6dbccda to 0x1d2b8e 2024-09-14T07:12:07.114 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:07.113+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:07.119 INFO:teuthology.orchestra.run.smithi071.stdout:1047 writesame 0x6775874 thru 0x67789a3 data_size 0x8(0x3130 bytes) 2024-09-14T07:12:07.121 INFO:teuthology.orchestra.run.smithi071.stdout:1049 trunc from 0x67789a4 to 0x79957b5 2024-09-14T07:12:07.126 INFO:teuthology.orchestra.run.smithi071.stdout:1051 read 0x3c6efff thru 0x3c77387 (0x8389 bytes) 2024-09-14T07:12:07.128 INFO:teuthology.orchestra.run.smithi071.stdout:1052 trunc from 0x79957b5 to 0x645eb96 2024-09-14T07:12:07.134 INFO:teuthology.orchestra.run.smithi071.stdout:1056 write 0x1702659 thru 0x170c78a (0xa132 bytes) 2024-09-14T07:12:07.136 INFO:teuthology.orchestra.run.smithi071.stdout:1057 writesame 0x1c62a21 thru 0x1c6aff7 data_size 0x51(0x85d7 bytes) 2024-09-14T07:12:07.140 INFO:teuthology.orchestra.run.smithi071.stdout:1058 trunc from 0x645eb96 to 0x6ebc95c 2024-09-14T07:12:07.146 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:07.146 INFO:teuthology.orchestra.run.smithi071.stdout:1060 read 0x5294abd thru 0x529c400 (0x7944 bytes) 2024-09-14T07:12:07.146 INFO:teuthology.orchestra.run.smithi071.stdout:1061 read 0x12940e0 thru 0x12994b3 (0x53d4 bytes) 2024-09-14T07:12:07.155 INFO:teuthology.orchestra.run.smithi071.stdout:1062 write 0xa25f83f thru 0xa261007 (0x17c9 bytes) 2024-09-14T07:12:07.160 INFO:teuthology.orchestra.run.smithi071.stdout:1064 punch from 0x3cefcea to 0x3cf7074, (0x738a bytes) 2024-09-14T07:12:07.160 INFO:teuthology.orchestra.run.smithi071.stdout:1065 write 0x91a30b1 thru 0x91aca89 (0x99d9 bytes) 2024-09-14T07:12:07.162 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:07.162 INFO:teuthology.orchestra.run.smithi071.stdout:1067 read 0x4f99970 thru 0x4fa7547 (0xdbd8 bytes) 2024-09-14T07:12:07.163 INFO:teuthology.orchestra.run.smithi071.stdout:1068 read 0x7ea5005 thru 0x7ea667c (0x1678 bytes) 2024-09-14T07:12:07.163 INFO:teuthology.orchestra.run.smithi071.stdout:1069 write 0x8f837a thru 0x8fa166 (0x1ded bytes) 2024-09-14T07:12:07.165 INFO:teuthology.orchestra.run.smithi071.stdout:1070 clone 8 order 25 su 16777216 sc 15 2024-09-14T07:12:07.180 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:07.180 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:07.180 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:07.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:07.208 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:07.207+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:07.308 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:07.307+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:07.333 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:07.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 29.197018313000001, 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.334 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:07.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:07.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:07.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:07.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:07.340 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.641701791, 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:07.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:07.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.346 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8693 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1941504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3542183630000002, 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033512578000000001, 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8693 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.347 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:07.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977710+0000", 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3500000000000005e-07 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977713+0000", 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.123e-06 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977716+0000", 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9919999999999999e-06 2024-09-14T07:12:07.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011124+0000", 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033407729999999997 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011161+0000", 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6729e-05 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011222+0000", 2024-09-14T07:12:07.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0961999999999997e-05 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8695 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1982464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3540961669999998, 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033512594, 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8695 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977832+0000", 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7800000000000001e-07 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977834+0000", 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2520000000000002e-06 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977840+0000", 2024-09-14T07:12:07.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9619999999999998e-06 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977843+0000", 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0989999999999999e-06 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011245+0000", 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033401765 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011281+0000", 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5824999999999997e-05 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011344+0000", 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8696 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 2076672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.355 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3540792559999999, 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033630489999999999, 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8696 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:07.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0100000000000001e-07 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977849+0000", 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6500000000000008e-07 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977852+0000", 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.976e-06 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977855+0000", 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3199999999999998e-06 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011365+0000", 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033510256000000002 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011403+0000", 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7768000000000002e-05 2024-09-14T07:12:07.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011479+0000", 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6003999999999999e-05 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8853 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3528243030000002, 2024-09-14T07:12:07.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033449174999999998, 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8853 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.84e-07 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979105+0000", 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1449999999999998e-06 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979108+0000", 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8710000000000001e-06 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979112+0000", 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2830000000000002e-06 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012548+0000", 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033436216999999997 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012552+0000", 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3749999999999996e-06 2024-09-14T07:12:07.364 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8854 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3528128740000001, 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033459328000000003, 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.365 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8854 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979115+0000", 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9299999999999999e-07 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979116+0000", 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6199999999999996e-07 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979119+0000", 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8789999999999999e-06 2024-09-14T07:12:07.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979121+0000", 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.401e-06 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012569+0000", 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033448569999999997 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012574+0000", 2024-09-14T07:12:07.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3229999999999999e-06 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8855 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3528037259999999, 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033472147000000001, 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:07.369 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8855 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.03e-07 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979125+0000", 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6899999999999996e-07 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979127+0000", 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-14T07:12:07.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979131+0000", 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1750000000000001e-06 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012592+0000", 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033460999999999998 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012596+0000", 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1869999999999999e-06 2024-09-14T07:12:07.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8856 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3527938509999999, 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033482968000000002, 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.373 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8856 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979163+0000", 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9280000000000001e-05 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979165+0000", 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4169999999999999e-06 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979169+0000", 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1690000000000002e-06 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979173+0000", 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0210000000000001e-06 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012612+0000", 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033438864999999998 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012616+0000", 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.216e-06 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8857 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.352749363, 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.03345882, 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8857 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.377 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979611+0000", 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000433423 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979617+0000", 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0750000000000003e-06 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979622+0000", 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9949999999999996e-06 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979627+0000", 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3290000000000004e-06 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012632+0000", 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033005372999999998 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012637+0000", 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6249999999999998e-06 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.380 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9390 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 847872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3143334279999999, 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033450345999999999, 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9390 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.58e-07 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017596+0000", 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.933e-06 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017602+0000", 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7089999999999999e-06 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017606+0000", 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5480000000000003e-06 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.050935+0000", 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033328363 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.050977+0000", 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1696999999999997e-05 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051044+0000", 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7737999999999994e-05 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9392 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 888832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3143155499999999, 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033568649999999998, 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.385 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9392 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017614+0000", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.708e-06 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017620+0000", 2024-09-14T07:12:07.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7100000000000004e-06 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017624+0000", 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6840000000000004e-06 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051070+0000", 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033445526000000003 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051110+0000", 2024-09-14T07:12:07.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0615999999999999e-05 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051180+0000", 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0092999999999995e-05 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9394 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 929792~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.314287932, 2024-09-14T07:12:07.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033671397999999998, 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9394 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017640+0000", 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9599999999999999e-07 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017642+0000", 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0849999999999999e-06 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017650+0000", 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017655+0000", 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4249999999999997e-06 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051205+0000", 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033549686000000002 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051244+0000", 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319000000000001e-05 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051311+0000", 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6759000000000002e-05 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9396 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1024000~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.393 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.314266049, 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033788708000000001, 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9396 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:07.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017662+0000", 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000002e-07 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017664+0000", 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.773e-06 2024-09-14T07:12:07.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017670+0000", 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017674+0000", 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7140000000000001e-06 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051335+0000", 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033660836999999999 2024-09-14T07:12:07.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051377+0000", 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2080999999999999e-05 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051450+0000", 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2856999999999997e-05 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.397 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9398 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1064960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3142474389999999, 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033904561, 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9398 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.46e-07 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017682+0000", 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8250000000000001e-06 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017688+0000", 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4890000000000003e-06 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017692+0000", 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4970000000000003e-06 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051475+0000", 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033782963999999999 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051517+0000", 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2014999999999997e-05 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051584+0000", 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7424999999999999e-05 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.401 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9400 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1159168~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3142295740000001, 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034021379999999997, 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9400 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.402 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1399999999999997e-07 2024-09-14T07:12:07.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017700+0000", 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.871e-06 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017705+0000", 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2989999999999996e-06 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017711+0000", 2024-09-14T07:12:07.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6389999999999997e-06 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051610+0000", 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033899171999999998 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051651+0000", 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1236999999999998e-05 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051719+0000", 2024-09-14T07:12:07.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7748000000000003e-05 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9402 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1200128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3142110690000002, 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034131720999999997, 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.406 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9402 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017717+0000", 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.22e-07 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017718+0000", 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7430000000000001e-06 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017724+0000", 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.57e-06 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017728+0000", 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3000000000000003e-06 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051743+0000", 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034015116999999997 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051783+0000", 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9904000000000003e-05 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051848+0000", 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4764999999999994e-05 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.410 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9404 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1294336~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3141935899999999, 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034257163, 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9404 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8599999999999999e-07 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017736+0000", 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.826e-06 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017742+0000", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017747+0000", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.259e-06 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051873+0000", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034125988000000003 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051918+0000", 2024-09-14T07:12:07.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5368000000000003e-05 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051991+0000", 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2721999999999999e-05 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.415 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9406 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1335296~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3141745399999998, 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034372278999999999, 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9406 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.416 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:07.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4600000000000005e-07 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017755+0000", 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017761+0000", 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8270000000000003e-06 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017766+0000", 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7979999999999996e-06 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052015+0000", 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034249479999999999 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052056+0000", 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0311000000000001e-05 2024-09-14T07:12:07.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052125+0000", 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9451999999999998e-05 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9408 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1376256~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.3141561930000001, 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034485301000000003, 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9408 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022916+0000", 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051447860000000002 2024-09-14T07:12:07.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022920+0000", 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022930+0000", 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8719999999999997e-06 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022937+0000", 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.922e-06 2024-09-14T07:12:07.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052150+0000", 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029213214000000001 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052190+0000", 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0054e-05 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:07.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052256+0000", 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6533999999999997e-05 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:07.425 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:07.426 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:07.426+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:07.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:07.527 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:07.527+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:07.531 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:07.531 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:07.531 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:07.531 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:07.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:07.629 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:07.628+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:07.684 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:07.685 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:07.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:07.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:12:07.737 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:07.736+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1117 3.b e28/23 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:head v 28'11, mlcod=28'8)", 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.253194+0000", 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.5510107429999991, 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075347909999999999, 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253194+0000", 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253194+0000", 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253195+0000", 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.06e-07 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253200+0000", 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1270000000000002e-06 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253211+0000", 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1189000000000001e-05 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253217+0000", 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0290000000000002e-06 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253259+0000", 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1709000000000003e-05 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.253277+0000", 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8111999999999999e-05 2024-09-14T07:12:07.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260699+0000", 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074221649999999997 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.260729+0000", 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9853999999999999e-05 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1232 3.b e29/23 3:d60f4289:::rbd_data.11822ba09815.0000000000000016:head v 29'15, mlcod=28'10)", 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.742627+0000", 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.0615778880000004, 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057279970000000003, 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742627+0000", 2024-09-14T07:12:07.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742627+0000", 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742628+0000", 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.92e-07 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742632+0000", 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6489999999999999e-06 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742641+0000", 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9749999999999996e-06 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742647+0000", 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2149999999999998e-06 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742700+0000", 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2784000000000001e-05 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.742718+0000", 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8029999999999998e-05 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748325+0000", 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005606733 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.748355+0000", 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9918999999999999e-05 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:1743 3.6 3:67ebc9b0:::rbd_data.1182823d0fd0.000000000000000b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.941976+0000", 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8622284310000001, 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099301189999999994, 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1743 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.941976+0000", 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.941976+0000", 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.941977+0000", 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.54e-07 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.941995+0000", 2024-09-14T07:12:07.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7810999999999999e-05 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.942008+0000", 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2591e-05 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.942016+0000", 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8660000000000006e-06 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.942070+0000", 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4182999999999999e-05 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.942220+0000", 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149987 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.943618+0000", 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001398774 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.951778+0000", 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081600249999999996 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.951798+0000", 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9072e-05 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.951856+0000", 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8180999999999997e-05 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.951907+0000", 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0775000000000001e-05 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2007 3.17 3:ef58fd75:::rbd_object_map.1182823d0fd0:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.104560+0000", 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6996452669999993, 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053090610000000003, 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2007 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104560+0000", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104560+0000", 2024-09-14T07:12:07.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104560+0000", 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8999999999999996e-07 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104564+0000", 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0459999999999999e-06 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104575+0000", 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0814e-05 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104586+0000", 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0499000000000001e-05 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104623+0000", 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7864999999999997e-05 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104673+0000", 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9740999999999997e-05 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.104899+0000", 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022593900000000001 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.105978+0000", 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010792499999999999 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.109674+0000", 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036953569999999998 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.109764+0000", 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0722000000000003e-05 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.109869+0000", 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104138 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2147 3.17 3:ef58fd75:::rbd_object_map.1182823d0fd0:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.270364+0000", 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5338410630000006, 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006553873, 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2147 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270364+0000", 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270364+0000", 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270364+0000", 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:07.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270366+0000", 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1349999999999999e-06 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270371+0000", 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2359999999999998e-06 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270373+0000", 2024-09-14T07:12:07.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.937e-06 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270911+0000", 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000537204 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.270964+0000", 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2842e-05 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:12:07.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.271183+0000", 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021956499999999999 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.271674+0000", 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049045299999999996 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.276862+0000", 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005188893 2024-09-14T07:12:07.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.276895+0000", 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2360999999999997e-05 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.276918+0000", 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2870999999999998e-05 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.832 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2244 3.1b 3:dc5aadb7:::rbd_data.1182823d0fd0.000000000000001c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.432609+0000", 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3715961740000004, 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010862597999999999, 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432609+0000", 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432609+0000", 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432609+0000", 2024-09-14T07:12:07.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5499999999999997e-07 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432613+0000", 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8060000000000001e-06 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432621+0000", 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2209999999999997e-06 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432626+0000", 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6759999999999998e-06 2024-09-14T07:12:07.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432664+0000", 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7580999999999998e-05 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.432737+0000", 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2948999999999996e-05 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.434139+0000", 2024-09-14T07:12:07.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014028109999999999 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.443318+0000", 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091784950000000001 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.443364+0000", 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6063000000000003e-05 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.443424+0000", 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9738999999999998e-05 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.443471+0000", 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7502e-05 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2358 3.17 3:ef58fd75:::rbd_object_map.1182823d0fd0:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.838 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.574860+0000", 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2293447129999997, 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054387039999999999, 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2358 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.574860+0000", 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.574860+0000", 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.574861+0000", 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8700000000000001e-07 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.574862+0000", 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9410000000000001e-06 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.574867+0000", 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3830000000000002e-06 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.574870+0000", 2024-09-14T07:12:07.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0730000000000001e-06 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.575415+0000", 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054536400000000001 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.575469+0000", 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3350000000000003e-05 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-09-14T07:12:07.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.575675+0000", 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020643899999999999 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.578068+0000", 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023933040000000002 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.580249+0000", 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002181049 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.580276+0000", 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6594999999999999e-05 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.580299+0000", 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2819e-05 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2369 3.1b 3:dd5c23f6:::rbd_data.1182823d0fd0.000000000000000e:head [set-alloc-hint object_size 2097152 write_size 2097152,write 645763~9597] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.592201+0000", 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2120033380000006, 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005296828, 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2369 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.845 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592201+0000", 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592201+0000", 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592202+0000", 2024-09-14T07:12:07.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1200000000000002e-07 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592211+0000", 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4100000000000008e-06 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592220+0000", 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592225+0000", 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9470000000000002e-06 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592261+0000", 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6303000000000001e-05 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592304+0000", 2024-09-14T07:12:07.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3223000000000003e-05 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.592413+0000", 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108485 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.593290+0000", 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087737299999999998 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.597439+0000", 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041491740000000003 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.597472+0000", 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2515000000000003e-05 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.597498+0000", 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6393999999999998e-05 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:2435 3.6 3:662a3841:::rbd_data.1182823d0fd0.000000000000003f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 765794~11645] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.668419+0000", 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.135786092, 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006007447, 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2435 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668419+0000", 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668419+0000", 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668420+0000", 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.066e-06 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668431+0000", 2024-09-14T07:12:07.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1514e-05 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668442+0000", 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0611000000000001e-05 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668447+0000", 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1839999999999998e-06 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668502+0000", 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4679999999999998e-05 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668579+0000", 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7492999999999998e-05 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.668701+0000", 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121809 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.673874+0000", 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051726970000000004 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.674101+0000", 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022675899999999999 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.674152+0000", 2024-09-14T07:12:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1007999999999997e-05 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.674426+0000", 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027462599999999998 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7723 3.1b 3:d8cdc2b5:::rbd_data.1182a7d91484.0000000000000140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:02.187791+0000", 2024-09-14T07:12:07.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.6164134130000001, 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062890059999999998, 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7723 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187791+0000", 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187791+0000", 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187792+0000", 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6099999999999999e-07 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187797+0000", 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8219999999999997e-06 2024-09-14T07:12:07.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187810+0000", 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2576e-05 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187817+0000", 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7200000000000006e-06 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187867+0000", 2024-09-14T07:12:07.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9283000000000002e-05 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.187926+0000", 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9472999999999998e-05 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.188016+0000", 2024-09-14T07:12:07.862 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone7 from 0xa261008 (overlap 0x1d2b8e) to 0x146b49 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9275000000000002e-05 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.188959+0000", 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094394200000000002 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.193976+0000", 2024-09-14T07:12:07.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050162940000000001 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.194033+0000", 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7639000000000002e-05 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.194080+0000", 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7021000000000003e-05 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7731 3.1b 3:dd10184b:::rbd_data.1182a7d91484.0000000000000155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:02.191187+0000", 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.6130174459999997, 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055365980000000002, 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7731 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191187+0000", 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191187+0000", 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191188+0000", 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0759999999999999e-06 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191195+0000", 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9120000000000001e-06 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191209+0000", 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3592e-05 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191217+0000", 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0509999999999997e-06 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191586+0000", 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036940399999999999 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191664+0000", 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7801999999999998e-05 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.191791+0000", 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126833 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.193704+0000", 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00191333 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196649+0000", 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002944477 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196687+0000", 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8417999999999997e-05 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196724+0000", 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6702999999999997e-05 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7739 3.1 3:84a1c26b:::rbd_data.1182a7d91484.000000000000015d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:02.196607+0000", 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.607597867, 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055123120000000001, 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7739 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196607+0000", 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196607+0000", 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196608+0000", 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5069999999999999e-06 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196614+0000", 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6359999999999999e-06 2024-09-14T07:12:07.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196624+0000", 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196631+0000", 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1359999999999999e-06 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196735+0000", 2024-09-14T07:12:07.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103732 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196783+0000", 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7746e-05 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196850+0000", 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6934000000000007e-05 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.197585+0000", 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073537500000000003 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.202021+0000", 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044354959999999997 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.202076+0000", 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5494000000000001e-05 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.202119+0000", 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3077000000000001e-05 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7744 3.1 3:84651391:::rbd_data.1182a7d91484.0000000000000189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:02.196881+0000", 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.6073237589999998, 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053460510000000001, 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7744 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196881+0000", 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196881+0000", 2024-09-14T07:12:07.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196882+0000", 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196887+0000", 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.758e-06 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196898+0000", 2024-09-14T07:12:07.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1231e-05 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.196905+0000", 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1670000000000002e-06 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.197139+0000", 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000234179 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.197209+0000", 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9387000000000005e-05 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.197312+0000", 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010306099999999999 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.198580+0000", 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012685140000000001 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.202154+0000", 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035732329999999999 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.202200+0000", 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6727999999999997e-05 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.202227+0000", 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6772e-05 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7748 3.1 3:863343df:::rbd_data.1182a7d91484.000000000000018d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:02.199218+0000", 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.6049868309999997, 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055697079999999996, 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7748 2024-09-14T07:12:07.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199218+0000", 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199218+0000", 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199219+0000", 2024-09-14T07:12:07.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.24e-06 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199224+0000", 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9579999999999998e-06 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199239+0000", 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4375e-05 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199246+0000", 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8520000000000004e-06 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199330+0000", 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3925999999999996e-05 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199407+0000", 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6415999999999995e-05 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199511+0000", 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010465 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.200321+0000", 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081007900000000001 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.204698+0000", 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043761290000000003 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.204749+0000", 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1598000000000003e-05 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.204788+0000", 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8485000000000002e-05 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7751 3.1 3:8377fbad:::rbd_data.1182a7d91484.0000000000000190:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:02.199492+0000", 2024-09-14T07:12:07.888 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.6047132839999998, 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054262319999999996, 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7751 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199492+0000", 2024-09-14T07:12:07.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199492+0000", 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199493+0000", 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9999999999999995e-07 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199497+0000", 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6099999999999999e-06 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199509+0000", 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2091e-05 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199518+0000", 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199745+0000", 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226884 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199810+0000", 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5686999999999996e-05 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.199907+0000", 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6850999999999998e-05 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.200766+0000", 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085865699999999997 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.204832+0000", 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040655760000000004 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.204882+0000", 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0733999999999999e-05 2024-09-14T07:12:07.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:02.204918+0000", 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5481999999999997e-05 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7882 3.1 3:84066770:::rbd_data.1182a7d91484.0000000000000049:head [delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.769304+0000", 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0349008150000003, 2024-09-14T07:12:07.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065863390000000001, 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7882 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769304+0000", 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769304+0000", 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769305+0000", 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1800000000000004e-07 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769309+0000", 2024-09-14T07:12:07.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3850000000000004e-06 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769322+0000", 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2438e-05 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769327+0000", 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4269999999999999e-06 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769372+0000", 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5118999999999999e-05 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769419+0000", 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7104999999999997e-05 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769518+0000", 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9047000000000002e-05 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772841+0000", 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033224040000000002 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.775798+0000", 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029572309999999998 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.775850+0000", 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1477000000000002e-05 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.775890+0000", 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0788000000000003e-05 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7884 3.6 3:64bf0d38:::rbd_data.1182a7d91484.000000000000004b:head [delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.769358+0000", 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0348467330000002, 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093045049999999994, 2024-09-14T07:12:07.900 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7884 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769358+0000", 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769358+0000", 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769359+0000", 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2500000000000005e-07 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769362+0000", 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2200000000000001e-06 2024-09-14T07:12:07.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769371+0000", 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0059999999999998e-06 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769382+0000", 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0538e-05 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769423+0000", 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1428999999999999e-05 2024-09-14T07:12:07.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769480+0000", 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7426000000000002e-05 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.769582+0000", 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101643 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.775679+0000", 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060971209999999996 2024-09-14T07:12:07.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.778604+0000", 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002924425 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.778636+0000", 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2796000000000002e-05 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.778663+0000", 2024-09-14T07:12:07.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6176000000000001e-05 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7900 3.12 3:4f3af331:::rbd_data.1182a7d91484.000000000000000e:head [stat,truncate 397312] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.783256+0000", 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0209484660000001, 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059326170000000003, 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7900 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783256+0000", 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783256+0000", 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783257+0000", 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1699999999999997e-07 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783262+0000", 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2250000000000002e-06 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783273+0000", 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1472e-05 2024-09-14T07:12:07.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783278+0000", 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783329+0000", 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0714000000000003e-05 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783412+0000", 2024-09-14T07:12:07.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3213000000000004e-05 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.783582+0000", 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016999199999999999 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.785772+0000", 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021900779999999998 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.789134+0000", 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033614109999999999 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.789165+0000", 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1266999999999997e-05 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.789189+0000", 2024-09-14T07:12:07.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3839999999999999e-05 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:7901 3.1f 3:fed46ee7:::rbd_data.1182a7d91484.000000000000000f:head [stat,truncate 397312] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.784370+0000", 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0198345709999996, 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068436010000000004, 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:07.912 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7901 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784370+0000", 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784370+0000", 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784371+0000", 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8899999999999998e-07 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784375+0000", 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8349999999999997e-06 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784385+0000", 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0519999999999999e-05 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784391+0000", 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1340000000000003e-06 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784438+0000", 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7939999999999998e-05 2024-09-14T07:12:07.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.784558+0000", 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011928 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.791108+0000", 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065501090000000001 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.791145+0000", 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7629999999999997e-05 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.791214+0000", 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8363999999999998e-05 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:12503 3.17 3:eee5d31f:::rbd_data.1182344c2865.0000000000000001:9 [sparse-read 917504~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.086320+0000", 2024-09-14T07:12:07.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.71788497900000003, 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069325960000000001, 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 12503 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.086320+0000", 2024-09-14T07:12:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.086320+0000", 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.086320+0000", 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0800000000000005e-07 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.086323+0000", 2024-09-14T07:12:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6369999999999999e-06 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.086330+0000", 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7750000000000004e-06 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.086334+0000", 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4379999999999997e-06 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.090254+0000", 2024-09-14T07:12:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039201959999999999 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.090350+0000", 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5146e-05 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.093252+0000", 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029028959999999999 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:07.922 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:07.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:07.923 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-14T07:12:07.924 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:07.922+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:07.924 INFO:teuthology.orchestra.run.smithi086.stdout:get_pg_num_history pg_num_history pg_num_history(e32 pg_nums {1={16=1},2={19=8},3={23=32}} deleted_pools ) 2024-09-14T07:12:07.924 INFO:teuthology.orchestra.run.smithi086.stdout:Importing pgid 3.c 2024-09-14T07:12:07.924 INFO:teuthology.orchestra.run.smithi086.stdout:Write #3:30c029c9:::rbd_data.1182823d0fd0.0000000000000007:head# 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:snapset 0=[]:{} 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:Write #3:32b8ddd0:::rbd_data.1182f1e71464.0000000000000001:head# 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:snapset 0=[]:{} 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:Write #3:3701356a:::rbd_data.1182f1e71464.0000000000000011:head# 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:snapset 0=[]:{} 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:write_pg epoch 32 info 3.c( v 32'24 (0'0,32'24] local-lis/les=23/24 n=3 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-14T07:12:07.925 INFO:teuthology.orchestra.run.smithi086.stdout:Import successful 2024-09-14T07:12:07.927 INFO:teuthology.orchestra.run.smithi071.stdout:1071 read 0x593bd0e thru 0x5944419 (0x870c bytes) 2024-09-14T07:12:07.928 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:07.928 INFO:teuthology.orchestra.run.smithi071.stdout:1073 write 0xdc7d0f thru 0xdd55ff (0xd8f1 bytes) 2024-09-14T07:12:07.938 INFO:teuthology.orchestra.run.smithi071.stdout:1074 clone 9 order 24 su 65536 sc 7 2024-09-14T07:12:08.024 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:08.024+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:08.027 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:08.028 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:08.125 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:08.125+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:08.183 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:08.183 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:08.227 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:08.226+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:08.294 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.294 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:08.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8810 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1556480~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3103072170000001, 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044018323999999998, 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.295 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8810 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4699999999999998e-07 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982819+0000", 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982822+0000", 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2679999999999999e-06 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982825+0000", 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5469999999999999e-06 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026671+0000", 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043846663000000001 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026744+0000", 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2267000000000005e-05 2024-09-14T07:12:08.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026836+0000", 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2280000000000004e-05 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8811 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1597440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3102971979999998, 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044155904000000003, 2024-09-14T07:12:08.299 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8811 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.22e-07 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982829+0000", 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4900000000000005e-07 2024-09-14T07:12:08.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982832+0000", 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9380000000000001e-06 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982837+0000", 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7540000000000003e-06 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026877+0000", 2024-09-14T07:12:08.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044039578000000003 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026917+0000", 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0089999999999997e-05 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026984+0000", 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6472999999999999e-05 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.303 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8812 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1638400~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3102817870000001, 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044336475, 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8812 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5699999999999998e-07 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982845+0000", 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6309999999999999e-06 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982851+0000", 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6149999999999996e-06 2024-09-14T07:12:08.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982855+0000", 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4939999999999997e-06 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027020+0000", 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044164634000000001 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027090+0000", 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0549000000000005e-05 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027180+0000", 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9195000000000002e-05 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8813 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1691648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982861+0000", 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3102635090000003, 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044560297999999998, 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8813 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982861+0000", 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982861+0000", 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983162+0000", 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030031399999999998 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983165+0000", 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.642e-06 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983172+0000", 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0299999999999996e-06 2024-09-14T07:12:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983181+0000", 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0329999999999997e-06 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027220+0000", 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044038881000000002 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027303+0000", 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2633999999999995e-05 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027422+0000", 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118764 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8814 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1732608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3099343650000002, 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044358841000000003, 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8814 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9400000000000001e-07 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983192+0000", 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2160000000000001e-06 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983197+0000", 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4710000000000001e-06 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983199+0000", 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7839999999999999e-06 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027460+0000", 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044260509000000003 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027506+0000", 2024-09-14T07:12:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5768e-05 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027549+0000", 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3798999999999999e-05 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8815 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1773568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983203+0000", 2024-09-14T07:12:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3099219340000001, 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044495282999999997, 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8815 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983203+0000", 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983203+0000", 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983947+0000", 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074430799999999995 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983951+0000", 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7100000000000001e-06 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983960+0000", 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.465e-06 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983967+0000", 2024-09-14T07:12:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4540000000000004e-06 2024-09-14T07:12:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027579+0000", 2024-09-14T07:12:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043612138000000002 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027636+0000", 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7083999999999998e-05 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027698+0000", 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2124000000000004e-05 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8816 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1826816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983991+0000", 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3091337569999997, 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043911048000000001, 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8816 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983991+0000", 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983991+0000", 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983992+0000", 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0299999999999997e-07 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983996+0000", 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8519999999999997e-06 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984009+0000", 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2917e-05 2024-09-14T07:12:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984014+0000", 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2299999999999999e-06 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027743+0000", 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043728744999999999 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027823+0000", 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9826000000000004e-05 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027902+0000", 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9574999999999996e-05 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8817 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1867776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.309100988, 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044076771000000001, 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8817 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:12:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984026+0000", 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.796e-06 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984031+0000", 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9080000000000003e-06 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984034+0000", 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9349999999999999e-06 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027953+0000", 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043918647999999998 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028032+0000", 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9668999999999999e-05 2024-09-14T07:12:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028101+0000", 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-05 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8818 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3090868379999998, 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044195990999999997, 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8818 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984039+0000", 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.119e-06 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984043+0000", 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2899999999999998e-06 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984045+0000", 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7350000000000001e-06 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028124+0000", 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044078820999999997 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028175+0000", 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0782999999999998e-05 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028234+0000", 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9018000000000003e-05 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8819 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1961984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984049+0000", 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3090755029999999, 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044338322999999999, 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8819 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984049+0000", 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984049+0000", 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984224+0000", 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017466000000000001 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984236+0000", 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1956e-05 2024-09-14T07:12:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984246+0000", 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0247e-05 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984252+0000", 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1909999999999997e-06 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028265+0000", 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044012453999999999 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028347+0000", 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1963000000000001e-05 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028388+0000", 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0852000000000001e-05 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8820 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 2002944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984263+0000", 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3088618509999996, 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044238078, 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8820 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984263+0000", 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984263+0000", 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984435+0000", 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172072 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984440+0000", 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3129999999999998e-06 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984458+0000", 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984466+0000", 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9109999999999993e-06 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028413+0000", 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043946458000000001 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028464+0000", 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.092e-05 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028501+0000", 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7620000000000002e-05 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8821 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984480+0000", 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3086450730000001, 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044133740999999997, 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8821 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984480+0000", 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984480+0000", 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984631+0000", 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000151285 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984635+0000", 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9620000000000004e-06 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984643+0000", 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6000000000000001e-06 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984648+0000", 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4090000000000002e-06 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028526+0000", 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043877712999999999 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028572+0000", 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6365000000000001e-05 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028614+0000", 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1406999999999998e-05 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8885 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984659+0000", 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3084657029999995, 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044073761000000003, 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8885 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984659+0000", 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984659+0000", 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984815+0000", 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015580100000000001 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984819+0000", 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5710000000000002e-06 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984827+0000", 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5690000000000005e-06 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984847+0000", 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0034000000000002e-05 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028643+0000", 2024-09-14T07:12:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043795331999999999 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028679+0000", 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6910999999999999e-05 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028733+0000", 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3542999999999999e-05 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8886 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984859+0000", 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.308265843, 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044065757999999997, 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8886 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984859+0000", 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984859+0000", 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985000+0000", 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141058 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985004+0000", 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6150000000000001e-06 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985013+0000", 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2e-06 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985019+0000", 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028757+0000", 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043737972 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028819+0000", 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1940000000000007e-05 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028925+0000", 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105672 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8887 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 126976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985031+0000", 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3080934419999997, 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044058517999999998, 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8887 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985031+0000", 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985031+0000", 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985261+0000", 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022976800000000001 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985271+0000", 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4269999999999997e-06 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985280+0000", 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0420000000000008e-06 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985285+0000", 2024-09-14T07:12:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.899e-06 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028984+0000", 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043699256999999998 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029033+0000", 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9319e-05 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029090+0000", 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6805999999999998e-05 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8888 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 167936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985295+0000", 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3078294980000003, 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044007486999999998, 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8888 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985295+0000", 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985295+0000", 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985460+0000", 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164587 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985465+0000", 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6419999999999998e-06 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985475+0000", 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0298e-05 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985482+0000", 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.092e-06 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029126+0000", 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043644027000000002 2024-09-14T07:12:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029215+0000", 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8938999999999997e-05 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029303+0000", 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7902e-05 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8889 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 208896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985495+0000", 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3076301700000004, 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043927473000000002, 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8889 2024-09-14T07:12:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985495+0000", 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985495+0000", 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985569+0000", 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4201000000000003e-05 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985572+0000", 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.309e-06 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985581+0000", 2024-09-14T07:12:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1560000000000001e-06 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985588+0000", 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2230000000000004e-06 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029318+0000", 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043729927000000002 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029372+0000", 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4700999999999997e-05 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029422+0000", 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9956000000000001e-05 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8890 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 303104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985597+0000", 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3075278199999998, 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044030518999999997, 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8890 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985597+0000", 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985597+0000", 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985834+0000", 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023693600000000001 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985845+0000", 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1246e-05 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985855+0000", 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8500000000000006e-06 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985867+0000", 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1735e-05 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029464+0000", 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043597612000000001 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029537+0000", 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2052999999999996e-05 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029628+0000", 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1087000000000004e-05 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8891 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 344064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985879+0000", 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.307245505, 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043845596000000001, 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8891 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985879+0000", 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985879+0000", 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986057+0000", 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017764500000000001 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986062+0000", 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7589999999999997e-06 2024-09-14T07:12:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986073+0000", 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1232e-05 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986079+0000", 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029642+0000", 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043563604999999998 2024-09-14T07:12:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029679+0000", 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6566999999999997e-05 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029725+0000", 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6291000000000001e-05 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8894 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 573440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.986397+0000", 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3067277080000004, 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043837460000000002, 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8894 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986397+0000", 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986397+0000", 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986600+0000", 2024-09-14T07:12:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000203179 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986614+0000", 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3504e-05 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986631+0000", 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6679000000000001e-05 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986640+0000", 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4660000000000005e-06 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.030059+0000", 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043418934999999999 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.030140+0000", 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1223999999999993e-05 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.030235+0000", 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4473000000000002e-05 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.392 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:08.394 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:08.393+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:08.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /var/log/ceph/exp.3.c.5 2024-09-14T07:12:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.497 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:08.497 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:08.497 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:08.511 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:08.510+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:08.596 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:08.595+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:08.608 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.608 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:08.608 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:08.608 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:08.608 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:08.697 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:08.697+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:728 3.0 e28/23 3:00096879:::rbd_data.1182c9370f88.0000000000000011:head v 28'4, mlcod=27'1)", 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:57.726526+0000", 2024-09-14T07:12:08.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.993113966999999, 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098813900000000007, 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726526+0000", 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726526+0000", 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726527+0000", 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726537+0000", 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6849999999999996e-06 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726555+0000", 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7963999999999999e-05 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726565+0000", 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8400000000000007e-06 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726633+0000", 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8288999999999996e-05 2024-09-14T07:12:08.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.726653+0000", 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0514e-05 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727473+0000", 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081930999999999996 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:57.727514+0000", 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1180000000000002e-05 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:878 3.0 e28/23 3:05bfc596:::rbd_data.11822ba09815.0000000000000011:head v 28'5, mlcod=28'2)", 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.043368+0000", 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.676271385, 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097807699999999994, 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.726 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043368+0000", 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043368+0000", 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043370+0000", 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.184e-06 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043415+0000", 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043430+0000", 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4688999999999999e-05 2024-09-14T07:12:08.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043438+0000", 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2870000000000004e-06 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043502+0000", 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534000000000005e-05 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.043525+0000", 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3087000000000001e-05 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.044305+0000", 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078062100000000001 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.044346+0000", 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1170000000000001e-05 2024-09-14T07:12:08.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1047 3.0 e28/23 3:06cd0b7a:::rbd_data.11822ba09815.0000000000000006:head v 28'8, mlcod=28'6)", 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.526825411000001, 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010714940000000001, 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192816+0000", 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.46e-06 2024-09-14T07:12:08.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192872+0000", 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6079000000000003e-05 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192890+0000", 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7873e-05 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192899+0000", 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1200000000000008e-06 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192965+0000", 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5675999999999999e-05 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192990+0000", 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5072999999999999e-05 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.193856+0000", 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086668300000000004 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.193886+0000", 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.953e-05 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1286 3.0 e29/23 3:06cd0b7a:::rbd_data.11822ba09815.0000000000000006:head v 29'10, mlcod=28'7)", 2024-09-14T07:12:08.735 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9629941510000002, 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011381449999999999, 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2800000000000003e-07 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756659+0000", 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101999999999999e-05 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756667+0000", 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8080000000000005e-06 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756675+0000", 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7139999999999993e-06 2024-09-14T07:12:08.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756755+0000", 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9999000000000004e-05 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756780+0000", 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5452e-05 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.757741+0000", 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096068200000000003 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.757784+0000", 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3059999999999998e-05 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1290 3.0 e29/23 3:05098d9c:::rbd_data.11822ba09815.0000000000000004:head v 29'11, mlcod=28'8)", 2024-09-14T07:12:08.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.759820+0000", 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9598197600000002, 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001887428, 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759820+0000", 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759820+0000", 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759821+0000", 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3200000000000004e-07 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759858+0000", 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7228000000000003e-05 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759874+0000", 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6175e-05 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759883+0000", 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2609999999999993e-06 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759944+0000", 2024-09-14T07:12:08.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1100999999999997e-05 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759963+0000", 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9499000000000001e-05 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761667+0000", 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001703644 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761707+0000", 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0688000000000001e-05 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1291 3.0 e29/23 3:05098d9c:::rbd_data.11822ba09815.0000000000000004:head v 29'13, mlcod=28'8)", 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.760753+0000", 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9588864800000003, 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013568289999999999, 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760753+0000", 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760753+0000", 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760754+0000", 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5099999999999999e-07 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760761+0000", 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5320000000000003e-06 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760773+0000", 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.271e-05 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760782+0000", 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5990000000000002e-06 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760851+0000", 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8826999999999997e-05 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760874+0000", 2024-09-14T07:12:08.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3235e-05 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762072+0000", 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011978679999999999 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762110+0000", 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8306999999999998e-05 2024-09-14T07:12:08.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:2530 3.9 e30/23 3:97f66fbb:::rbd_data.1182823d0fd0.000000000000001e:head v 30'5, mlcod=29'3)", 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.9516719780000003, 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010146459999999999, 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.750 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8599999999999999e-07 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767973+0000", 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7029999999999997e-06 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767993+0000", 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9811999999999999e-05 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768001+0000", 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7150000000000004e-06 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768063+0000", 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1329999999999997e-05 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768084+0000", 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.177e-05 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768944+0000", 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085967499999999996 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768982+0000", 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355000000000001e-05 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7823 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'32, mlcod=32'30)", 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9869150920000003, 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020025759999999998, 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732726+0000", 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6799999999999999e-07 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732731+0000", 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6119999999999998e-06 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732742+0000", 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.093e-05 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732748+0000", 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4990000000000002e-06 2024-09-14T07:12:08.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732790+0000", 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531000000000003e-05 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732803+0000", 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3135999999999999e-05 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734693+0000", 2024-09-14T07:12:08.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889967 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734727+0000", 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4032999999999998e-05 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7838 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'34, mlcod=34'32)", 2024-09-14T07:12:08.759 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9753840700000005, 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00194644, 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744257+0000", 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0100000000000004e-07 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744263+0000", 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2779999999999999e-06 2024-09-14T07:12:08.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744276+0000", 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3335e-05 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744283+0000", 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8750000000000002e-06 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744328+0000", 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5000999999999998e-05 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744348+0000", 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0239000000000001e-05 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746170+0000", 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018221859999999999 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746202+0000", 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1724999999999999e-05 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7864 3.9 e34/23 3:9662e057:::rbd_data.1182a7d91484.0000000000000022:head v 34'31, mlcod=32'28)", 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9593259009999997, 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020061520000000002, 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:08.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760325+0000", 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0907000000000001e-05 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760333+0000", 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2150000000000001e-06 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760348+0000", 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5026e-05 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760405+0000", 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6885999999999997e-05 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760426+0000", 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0265e-05 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762272+0000", 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001846349 2024-09-14T07:12:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762320+0000", 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8106000000000003e-05 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7866 3.4 e34/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:head v 34'37, mlcod=34'34)", 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9574012359999999, 2024-09-14T07:12:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026596739999999999, 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:08.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762266+0000", 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7076e-05 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762280+0000", 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4004e-05 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762288+0000", 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.678e-06 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762339+0000", 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0430000000000003e-05 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762357+0000", 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8850000000000001e-05 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764858+0000", 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004010000000002 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764898+0000", 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0414000000000003e-05 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9527766389999996, 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.774 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:08.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.95167775, 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:08.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:08.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7905 3.4 e34/23 3:20b4893f:::rbd_data.1182a7d91484.0000000000000013:head v 34'39, mlcod=34'35)", 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9274883369999998, 2024-09-14T07:12:08.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00219133, 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:08.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792152+0000", 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792161+0000", 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3809999999999999e-06 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792177+0000", 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5838e-05 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792185+0000", 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9400000000000002e-06 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792248+0000", 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2928000000000005e-05 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792268+0000", 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0404999999999999e-05 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794300+0000", 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020316819999999999 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794343+0000", 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3183999999999999e-05 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.924834591, 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:08.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12482 3.0 e37/23 3:04a1ed04:::rbd_data.1182a59bd9ad.0000000000000028:head v 37'42, mlcod=37'39)", 2024-09-14T07:12:08.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.6380245840000001, 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028333389999999998, 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081616+0000", 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7300000000000005e-07 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081622+0000", 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081638+0000", 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6429000000000001e-05 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081646+0000", 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.622e-06 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081706+0000", 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9840000000000003e-05 2024-09-14T07:12:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081724+0000", 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8150000000000001e-05 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084410+0000", 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026862029999999999 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084449+0000", 2024-09-14T07:12:08.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8342e-05 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12712 3.0 e38/23 3:01cc77df:::rbd_header.1182c19f8219:head v 38'47, mlcod=38'45)", 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.790264+0000", 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.92937551399999996, 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001886551, 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790264+0000", 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790264+0000", 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790265+0000", 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5799999999999999e-07 2024-09-14T07:12:08.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790274+0000", 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6729999999999998e-06 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790285+0000", 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.115e-05 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790291+0000", 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3720000000000001e-06 2024-09-14T07:12:08.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790336+0000", 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4629000000000002e-05 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790353+0000", 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7476999999999999e-05 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.792092+0000", 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739186 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.792151+0000", 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8406000000000003e-05 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:08.801 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.91154058599999999, 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:08.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:08.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.91147117200000005, 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12757 3.9 e38/23 3:908f411a:::rbd_data.1182a59bd9ad.0000000000000009:head v 38'100, mlcod=37'97)", 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.824498+0000", 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.89514153200000002, 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001035565, 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824498+0000", 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824498+0000", 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824500+0000", 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.339e-06 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824509+0000", 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8630000000000003e-06 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824527+0000", 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7929000000000001e-05 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824537+0000", 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8630000000000003e-06 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824602+0000", 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4375999999999995e-05 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824623+0000", 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1223e-05 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.825505+0000", 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088168100000000004 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.825534+0000", 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9291000000000001e-05 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.815 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:08.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:08.818 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:12:08.818 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:08.815+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:08.820 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone8 from 0xa261008 (overlap 0xa261008) to 0x0 2024-09-14T07:12:08.917 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:08.917+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:08.934 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:13265 3.8 3:14853814:::rbd_header.1182823d0fd0:head [call rbd.get_access_timestamp in=23b out=8b,call rbd.get_modify_timestamp in=23b out=8b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:08.934020+0000", 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.000210344, 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000232036, 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 13265 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934020+0000", 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934020+0000", 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934021+0000", 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8999999999999995e-07 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934025+0000", 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4230000000000001e-06 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934032+0000", 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7279999999999995e-06 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934037+0000", 2024-09-14T07:12:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934075+0000", 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7651999999999998e-05 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:08.934142+0000", 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7071999999999998e-05 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-09-14T07:12:08.939 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:08.940 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-14T07:12:08.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:08.947 INFO:teuthology.orchestra.run.smithi071.stdout:1075 trunc from 0xa261008 to 0xc444623 2024-09-14T07:12:08.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:08.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:08.958 INFO:teuthology.orchestra.run.smithi071.stdout:1076 read 0x1b0ba27 thru 0x1b12fff (0x75d9 bytes) 2024-09-14T07:12:08.958 INFO:teuthology.orchestra.run.smithi071.stdout:1079 write 0x665edcd thru 0x66602c0 (0x14f4 bytes) 2024-09-14T07:12:08.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:08.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:09.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:09.010 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:09.019 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:09.018+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:09.019 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.026 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:09.026 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:09.027 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:09.027 INFO:teuthology.orchestra.run.smithi071.stdout:1081 write 0xe76024f thru 0xe76d872 (0xd624 bytes) 2024-09-14T07:12:09.031 INFO:teuthology.orchestra.run.smithi071.stdout:1082 punch from 0x54baba8 to 0x54c08b4, (0x5d0c bytes) 2024-09-14T07:12:09.031 INFO:teuthology.orchestra.run.smithi071.stdout:1083 writesame 0x4b1e861 thru 0x4b26e5f data_size 0x1(0x85ff bytes) 2024-09-14T07:12:09.046 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:09.046 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:09.059 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.059 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:09.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:09.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:09.069 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:09.069 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:09.147 INFO:teuthology.orchestra.run.smithi071.stdout:1084 write 0x9fccd50 thru 0x9fcfb68 (0x2e19 bytes) 2024-09-14T07:12:09.147 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:09.146+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:09.158 INFO:teuthology.orchestra.run.smithi071.stdout:1085 read 0xbdf2d2e thru 0xbdf5c89 (0x2f5c bytes) 2024-09-14T07:12:09.176 INFO:teuthology.orchestra.run.smithi071.stdout:1086 trunc from 0xe76d873 to 0x256438 2024-09-14T07:12:09.213 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.220 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:09.219+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:09.222 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.222 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.230 INFO:teuthology.orchestra.run.smithi071.stdout:1088 write 0x9e84b0f thru 0x9e90062 (0xb554 bytes) 2024-09-14T07:12:09.234 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:09.237 INFO:teuthology.orchestra.run.smithi071.stdout:1090 trunc from 0x9e90063 to 0xba93298 2024-09-14T07:12:09.242 INFO:teuthology.orchestra.run.smithi071.stdout:1091 read 0xab6474e thru 0xab651a7 (0xa5a bytes) 2024-09-14T07:12:09.242 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.242 INFO:teuthology.orchestra.run.smithi071.stdout:1094 write 0xb31ff4 thru 0xb3856e (0x657b bytes) 2024-09-14T07:12:09.243 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.243 INFO:teuthology.orchestra.run.smithi071.stdout:1097 read 0x11b2f06 thru 0x11b3fee (0x10e9 bytes) 2024-09-14T07:12:09.243 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.251 INFO:teuthology.orchestra.run.smithi071.stdout:1102 trunc from 0xba93298 to 0x4f02de0 2024-09-14T07:12:09.277 INFO:teuthology.orchestra.run.smithi071.stdout:1104 write 0x6d68827 thru 0x6d7846d (0xfc47 bytes) 2024-09-14T07:12:09.279 INFO:teuthology.orchestra.run.smithi071.stdout:1106 punch from 0x1d1837f to 0x1d24781, (0xc402 bytes) 2024-09-14T07:12:09.279 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.279 INFO:teuthology.orchestra.run.smithi071.stdout:1109 writesame 0x2e16ba2 thru 0x2e18e1c data_size 0xd(0x227b bytes) 2024-09-14T07:12:09.285 INFO:teuthology.orchestra.run.smithi071.stdout:1110 trunc from 0x6d7846e to 0xaaea305 2024-09-14T07:12:09.301 INFO:teuthology.orchestra.run.smithi071.stdout:1111 write 0xe0fa1d2 thru 0xe0ff661 (0x5490 bytes) 2024-09-14T07:12:09.304 INFO:teuthology.orchestra.run.smithi071.stdout:1114 writesame 0xb3ec629 thru 0xb3fbc0a data_size 0x12(0xf5e2 bytes) 2024-09-14T07:12:09.309 INFO:teuthology.orchestra.run.smithi071.stdout:1116 write 0x85b6f34 thru 0x85bbe5e (0x4f2b bytes) 2024-09-14T07:12:09.311 INFO:teuthology.orchestra.run.smithi071.stdout:1117 write 0x5aef72c thru 0x5afec10 (0xf4e5 bytes) 2024-09-14T07:12:09.313 INFO:teuthology.orchestra.run.smithi071.stdout:1119 write 0x5f05f45 thru 0x5f117aa (0xb866 bytes) 2024-09-14T07:12:09.314 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.314 INFO:teuthology.orchestra.run.smithi071.stdout:1123 writesame 0x4ddcf87 thru 0x4de15c2 data_size 0x1f(0x463c bytes) 2024-09-14T07:12:09.320 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:09.319+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:09.321 INFO:teuthology.orchestra.run.smithi071.stdout:1125 write 0xe65d94d thru 0xe65efb6 (0x166a bytes) 2024-09-14T07:12:09.329 INFO:teuthology.orchestra.run.smithi071.stdout:1126 trunc from 0xe65efb7 to 0xa13a267 2024-09-14T07:12:09.340 INFO:teuthology.orchestra.run.smithi071.stdout:1127 read 0x6b7c716 thru 0x6b7f06f (0x295a bytes) 2024-09-14T07:12:09.340 INFO:teuthology.orchestra.run.smithi071.stdout:1128 write 0x3d0bc7b thru 0x3d180ae (0xc434 bytes) 2024-09-14T07:12:09.348 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.348 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.351 INFO:teuthology.orchestra.run.smithi071.stdout:1129 writesame 0xd2e785e thru 0xd2f76f8 data_size 0x1(0xfe9b bytes) 2024-09-14T07:12:09.351 INFO:teuthology.orchestra.run.smithi071.stdout:1130 write 0x82c44b6 thru 0x82c5ddf (0x192a bytes) 2024-09-14T07:12:09.355 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.355 INFO:teuthology.orchestra.run.smithi071.stdout:1135 read 0x31eed53 thru 0x31f76bb (0x8969 bytes) 2024-09-14T07:12:09.355 INFO:teuthology.orchestra.run.smithi071.stdout:1136 punch from 0xb3e1fc to 0xb4a105, (0xbf09 bytes) 2024-09-14T07:12:09.355 INFO:teuthology.orchestra.run.smithi071.stdout:1137 read 0x5235c27 thru 0x523a129 (0x4503 bytes) 2024-09-14T07:12:09.356 INFO:teuthology.orchestra.run.smithi071.stdout:1138 punch from 0x854de0a to 0x855d332, (0xf528 bytes) 2024-09-14T07:12:09.356 INFO:teuthology.orchestra.run.smithi071.stdout:1139 write 0x3714abf thru 0x371f408 (0xa94a bytes) 2024-09-14T07:12:09.357 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.357 INFO:teuthology.orchestra.run.smithi071.stdout:1141 writesame 0xb49cefe thru 0xb4a6f2c data_size 0x1(0xa02f bytes) 2024-09-14T07:12:09.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:09.371 INFO:teuthology.orchestra.run.smithi071.stdout:1142 write 0x30411e6 thru 0x304c10d (0xaf28 bytes) 2024-09-14T07:12:09.373 INFO:teuthology.orchestra.run.smithi071.stdout:1143 write 0x5a22dc4 thru 0x5a264a4 (0x36e1 bytes) 2024-09-14T07:12:09.374 INFO:teuthology.orchestra.run.smithi071.stdout:1144 read 0x59320e9 thru 0x5932d3b (0xc53 bytes) 2024-09-14T07:12:09.374 INFO:teuthology.orchestra.run.smithi071.stdout:1145 write 0x41893c8 thru 0x4195684 (0xc2bd bytes) 2024-09-14T07:12:09.376 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.376 INFO:teuthology.orchestra.run.smithi071.stdout:1147 writesame 0xbfad33a thru 0xbfb07c1 data_size 0x29(0x3488 bytes) 2024-09-14T07:12:09.380 INFO:teuthology.orchestra.run.smithi071.stdout:1149 write 0x28e2948 thru 0x28e6f76 (0x462f bytes) 2024-09-14T07:12:09.386 INFO:teuthology.orchestra.run.smithi071.stdout:1150 trunc from 0xd2f76f9 to 0xacb2c0e 2024-09-14T07:12:09.393 INFO:teuthology.orchestra.run.smithi071.stdout:1151 read 0xa6f354c thru 0xa6fd6ce (0xa183 bytes) 2024-09-14T07:12:09.393 INFO:teuthology.orchestra.run.smithi071.stdout:1152 read 0x69d0592 thru 0x69ddf56 (0xd9c5 bytes) 2024-09-14T07:12:09.393 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.393 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.394 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.394 INFO:teuthology.orchestra.run.smithi071.stdout:1160 write 0x43f1fce thru 0x43f9f29 (0x7f5c bytes) 2024-09-14T07:12:09.395 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.395 INFO:teuthology.orchestra.run.smithi071.stdout:1163 punch from 0xa652357 to 0xa6561ae, (0x3e57 bytes) 2024-09-14T07:12:09.395 INFO:teuthology.orchestra.run.smithi071.stdout:1164 read 0x7d7bcc thru 0x7dc9ff (0x4e34 bytes) 2024-09-14T07:12:09.395 INFO:teuthology.orchestra.run.smithi071.stdout:1165 write 0xa25aae7 thru 0xa26154d (0x6a67 bytes) 2024-09-14T07:12:09.397 INFO:teuthology.orchestra.run.smithi071.stdout:1167 trunc from 0xacb2c0e to 0xa30c5d8 2024-09-14T07:12:09.403 INFO:teuthology.orchestra.run.smithi071.stdout:1168 write 0xde361e thru 0xdebf38 (0x891b bytes) 2024-09-14T07:12:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:1170 write 0x8ea59cf thru 0x8eb530e (0xf940 bytes) 2024-09-14T07:12:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:1172 read 0x8856b93 thru 0x885f986 (0x8df4 bytes) 2024-09-14T07:12:09.415 INFO:teuthology.orchestra.run.smithi071.stdout:1173 write 0xcf143da thru 0xcf210d3 (0xccfa bytes) 2024-09-14T07:12:09.417 INFO:teuthology.orchestra.run.smithi071.stdout:1174 write 0x96d68e6 thru 0x96dc8b2 (0x5fcd bytes) 2024-09-14T07:12:09.418 INFO:teuthology.orchestra.run.smithi071.stdout:1175 read 0x5ea8704 thru 0x5eb4dc8 (0xc6c5 bytes) 2024-09-14T07:12:09.419 INFO:teuthology.orchestra.run.smithi071.stdout:1176 write 0x2713d5a thru 0x271d744 (0x99eb bytes) 2024-09-14T07:12:09.420 INFO:teuthology.orchestra.run.smithi071.stdout:1177 write 0x5fd3114 thru 0x5fe2665 (0xf552 bytes) 2024-09-14T07:12:09.421 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:09.420+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:09.430 INFO:teuthology.orchestra.run.smithi071.stdout:1178 trunc from 0xcf210d4 to 0x61d05cb 2024-09-14T07:12:09.442 INFO:teuthology.orchestra.run.smithi071.stdout:1179 punch from 0x16c16bb to 0x16cea62, (0xd3a7 bytes) 2024-09-14T07:12:09.442 INFO:teuthology.orchestra.run.smithi071.stdout:1182 writesame 0x2604d7c thru 0x260995e data_size 0x1(0x4be3 bytes) 2024-09-14T07:12:09.449 INFO:teuthology.orchestra.run.smithi071.stdout:1184 read 0x322cf1c thru 0x3234b96 (0x7c7b bytes) 2024-09-14T07:12:09.465 INFO:teuthology.orchestra.run.smithi071.stdout:1186 write 0xd15da68 thru 0xd16d2d6 (0xf86f bytes) 2024-09-14T07:12:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:1187 punch from 0x4eab810 to 0x4eb7a45, (0xc235 bytes) 2024-09-14T07:12:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:1189 read 0x363589 thru 0x36a29c (0x6d14 bytes) 2024-09-14T07:12:09.472 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.472 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.476 INFO:teuthology.orchestra.run.smithi071.stdout:1190 write 0xe06a167 thru 0xe06c16b (0x2005 bytes) 2024-09-14T07:12:09.481 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.481 INFO:teuthology.orchestra.run.smithi071.stdout:1192 write 0x8687d3d thru 0x8693fe0 (0xc2a4 bytes) 2024-09-14T07:12:09.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:09.482 INFO:teuthology.orchestra.run.smithi071.stdout:1193 writesame 0xcaafa4e thru 0xcab7591 data_size 0x17(0x7b44 bytes) 2024-09-14T07:12:09.489 INFO:teuthology.orchestra.run.smithi071.stdout:1195 read 0x30cb268 thru 0x30ce425 (0x31be bytes) 2024-09-14T07:12:09.489 INFO:teuthology.orchestra.run.smithi071.stdout:1196 write 0xde922c4 thru 0xde9b8c8 (0x9605 bytes) 2024-09-14T07:12:09.495 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.495 INFO:teuthology.orchestra.run.smithi071.stdout:1198 write 0xc877b6 thru 0xc965a8 (0xedf3 bytes) 2024-09-14T07:12:09.503 INFO:teuthology.orchestra.run.smithi071.stdout:1199 write 0xe8a8d77 thru 0xe8af37b (0x6605 bytes) 2024-09-14T07:12:09.506 INFO:teuthology.orchestra.run.smithi071.stdout:1200 read 0x6e8c446 thru 0x6e9a59c (0xe157 bytes) 2024-09-14T07:12:09.507 INFO:teuthology.orchestra.run.smithi071.stdout:1201 punch from 0xd9103f7 to 0xd91361d, (0x3226 bytes) 2024-09-14T07:12:09.507 INFO:teuthology.orchestra.run.smithi071.stdout:1202 writesame 0x1414374 thru 0x141a00c data_size 0xb(0x5c99 bytes) 2024-09-14T07:12:09.508 INFO:teuthology.orchestra.run.smithi071.stdout:1207 punch from 0x476e7 to 0x50250, (0x8b69 bytes) 2024-09-14T07:12:09.508 INFO:teuthology.orchestra.run.smithi071.stdout:1208 write 0xccdd1ec thru 0xcce18c7 (0x46dc bytes) 2024-09-14T07:12:09.509 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.509 INFO:teuthology.orchestra.run.smithi071.stdout:1210 read 0x3a4f1d2 thru 0x3a51d5d (0x2b8c bytes) 2024-09-14T07:12:09.510 INFO:teuthology.orchestra.run.smithi071.stdout:1212 read 0x13a9639 thru 0x13b2c63 (0x962b bytes) 2024-09-14T07:12:09.510 INFO:teuthology.orchestra.run.smithi071.stdout:1213 writesame 0x12f7834 thru 0x12f9cf1 data_size 0x1(0x24be bytes) 2024-09-14T07:12:09.515 INFO:teuthology.orchestra.run.smithi071.stdout:1216 read 0x5bf6d40 thru 0x5c01c7d (0xaf3e bytes) 2024-09-14T07:12:09.515 INFO:teuthology.orchestra.run.smithi071.stdout:1217 write 0xb19cd1c thru 0xb19f2b3 (0x2598 bytes) 2024-09-14T07:12:09.521 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:09.521+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:09.532 INFO:teuthology.orchestra.run.smithi071.stdout:1218 trunc from 0xe8af37c to 0x2af3c5b 2024-09-14T07:12:09.558 INFO:teuthology.orchestra.run.smithi071.stdout:1219 write 0x8707f96 thru 0x870d630 (0x569b bytes) 2024-09-14T07:12:09.561 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.561 INFO:teuthology.orchestra.run.smithi071.stdout:1223 punch from 0x72e755c to 0x72f461f, (0xd0c3 bytes) 2024-09-14T07:12:09.561 INFO:teuthology.orchestra.run.smithi071.stdout:1224 punch from 0x836ccdc to 0x836fd6f, (0x3093 bytes) 2024-09-14T07:12:09.561 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.561 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.565 INFO:teuthology.orchestra.run.smithi071.stdout:1227 trunc from 0x870d631 to 0xc715139 2024-09-14T07:12:09.582 INFO:teuthology.orchestra.run.smithi071.stdout:1228 write 0xed22505 thru 0xed30149 (0xdc45 bytes) 2024-09-14T07:12:09.586 INFO:teuthology.orchestra.run.smithi071.stdout:1229 read 0xdc95b96 thru 0xdca5957 (0xfdc2 bytes) 2024-09-14T07:12:09.586 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.586 INFO:teuthology.orchestra.run.smithi071.stdout:1231 write 0x5e92c5a thru 0x5e99335 (0x66dc bytes) 2024-09-14T07:12:09.587 INFO:teuthology.orchestra.run.smithi071.stdout:1232 write 0xdc790ea thru 0xdc8483c (0xb753 bytes) 2024-09-14T07:12:09.591 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.591 INFO:teuthology.orchestra.run.smithi071.stdout:1235 writesame 0x711640a thru 0x711c78d data_size 0x42(0x6384 bytes) 2024-09-14T07:12:09.593 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.593 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.594 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:09.594 INFO:teuthology.orchestra.run.smithi071.stdout:1237 clone 10 order 18 su 16384 sc 5 2024-09-14T07:12:09.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:09.646 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:09.645+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:09.705 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.705 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:09.723 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:09.723+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:09.824 INFO:teuthology.orchestra.run.smithi071.stdout:leaving image image_client.0-clone9 intact 2024-09-14T07:12:09.824 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:09.823+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:09.861 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:09.861 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:09.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:09.957 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:09.956+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:10.019 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-14T07:12:10.019 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.019 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:10.026 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:10.025+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:10.026 INFO:teuthology.orchestra.run.smithi071.stdout:1239 trunc from 0xed3014a to 0x9c929fe 2024-09-14T07:12:10.042 INFO:teuthology.orchestra.run.smithi071.stdout:1242 write 0x52202a1 thru 0x5225fa5 (0x5d05 bytes) 2024-09-14T07:12:10.047 INFO:teuthology.orchestra.run.smithi071.stdout:1243 write 0x51b47d9 thru 0x51c03bf (0xbbe7 bytes) 2024-09-14T07:12:10.062 INFO:teuthology.orchestra.run.smithi071.stdout:1245 writesame 0xdf94794 thru 0xdf98f5f data_size 0xa(0x47cc bytes) 2024-09-14T07:12:10.062 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:10.062 INFO:teuthology.orchestra.run.smithi071.stdout:1251 writesame 0x7fd6cd4 thru 0x7fd9d78 data_size 0x7(0x30a5 bytes) 2024-09-14T07:12:10.066 INFO:teuthology.orchestra.run.smithi071.stdout:1252 writesame 0xda11f20 thru 0xda1dbb4 data_size 0x1(0xbc95 bytes) 2024-09-14T07:12:10.082 INFO:teuthology.orchestra.run.smithi071.stdout:1253 punch from 0xb7977ce to 0xb79c0be, (0x48f0 bytes) 2024-09-14T07:12:10.085 INFO:teuthology.orchestra.run.smithi071.stdout:1254 trunc from 0xdf98f60 to 0xb496133 2024-09-14T07:12:10.095 INFO:teuthology.orchestra.run.smithi071.stdout:1255 writesame 0x11c3909 thru 0x11cab1b data_size 0x1d(0x7213 bytes) 2024-09-14T07:12:10.107 INFO:teuthology.orchestra.run.smithi071.stdout:1256 read 0x24d79c5 thru 0x24db115 (0x3751 bytes) 2024-09-14T07:12:10.108 INFO:teuthology.orchestra.run.smithi071.stdout:1257 writesame 0x23c403 thru 0x2442d0 data_size 0x1(0x7ece bytes) 2024-09-14T07:12:10.122 INFO:teuthology.orchestra.run.smithi071.stdout:1258 read 0x60236dd thru 0x602f0be (0xb9e2 bytes) 2024-09-14T07:12:10.123 INFO:teuthology.orchestra.run.smithi071.stdout:1259 read 0x92f05ee thru 0x92fe4dc (0xdeef bytes) 2024-09-14T07:12:10.124 INFO:teuthology.orchestra.run.smithi071.stdout:1262 write 0xb19f028 thru 0xb1a75fc (0x85d5 bytes) 2024-09-14T07:12:10.126 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:10.125+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:10.129 INFO:teuthology.orchestra.run.smithi071.stdout:1268 writesame 0x56cce67 thru 0x56ce2b4 data_size 0x17(0x144e bytes) 2024-09-14T07:12:10.142 INFO:teuthology.orchestra.run.smithi071.stdout:1269 write 0xe3f3296 thru 0xe3f3e6a (0xbd5 bytes) 2024-09-14T07:12:10.144 INFO:teuthology.orchestra.run.smithi071.stdout:1270 writesame 0xc4606a8 thru 0xc4617f8 data_size 0xd(0x1151 bytes) 2024-09-14T07:12:10.149 INFO:teuthology.orchestra.run.smithi071.stdout:1271 punch from 0x67d56d3 to 0x67e1c3c, (0xc569 bytes) 2024-09-14T07:12:10.149 INFO:teuthology.orchestra.run.smithi071.stdout:1272 read 0x179f4f8 thru 0x17a7220 (0x7d29 bytes) 2024-09-14T07:12:10.151 INFO:teuthology.orchestra.run.smithi071.stdout:1274 trunc from 0xe3f3e6b to 0xcf7739f 2024-09-14T07:12:10.162 INFO:teuthology.orchestra.run.smithi071.stdout:1275 read 0x28f3cdf thru 0x28fcc26 (0x8f48 bytes) 2024-09-14T07:12:10.163 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:10.171 INFO:teuthology.orchestra.run.smithi071.stdout:1278 trunc from 0xcf7739f to 0x5e1d982 2024-09-14T07:12:10.178 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.179 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:10.200 INFO:teuthology.orchestra.run.smithi071.stdout:1279 write 0x23b96ad thru 0x23c8f53 (0xf8a7 bytes) 2024-09-14T07:12:10.209 INFO:teuthology.orchestra.run.smithi071.stdout:1280 write 0x52e6b50 thru 0x52e6f5a (0x40b bytes) 2024-09-14T07:12:10.220 INFO:teuthology.orchestra.run.smithi071.stdout:1281 write 0x82a6719 thru 0x82b0195 (0x9a7d bytes) 2024-09-14T07:12:10.225 INFO:teuthology.orchestra.run.smithi071.stdout:1282 writesame 0x25aeaf6 thru 0x25bb2df data_size 0x1(0xc7ea bytes) 2024-09-14T07:12:10.227 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:10.226+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:10.245 INFO:teuthology.orchestra.run.smithi071.stdout:1284 read 0x74e8077 thru 0x74ea19f (0x2129 bytes) 2024-09-14T07:12:10.253 INFO:teuthology.orchestra.run.smithi071.stdout:1286 trunc from 0x82b0196 to 0xd9794e 2024-09-14T07:12:10.286 INFO:teuthology.orchestra.run.smithi071.stdout:1287 clone 11 order 23 su 262144 sc 7 2024-09-14T07:12:10.305 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.306 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:10.358 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:10.357+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:10.416 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.417 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:10.469 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:10.468+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:10.529 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.529 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.529 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:10.528+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:10.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:10.630 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:10.629+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:10.680 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.680 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:10.732 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:10.731+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:10.796 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.796 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:10.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:12:10.840 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone10 from 0xd9794e (overlap 0xd9794e) to 0x6cbca7 2024-09-14T07:12:10.840 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:10.839+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:10.933 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:10.932+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:10.959 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:10.959 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:10.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:11.017 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-14T07:12:11.033 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:11.032+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:11.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:11.129 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:11.129 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:11.134 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:11.134+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:11.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:11.215 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:11.216 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:11.235 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:11.234+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:11.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:11.250 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8810 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1556480~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2656339540000001, 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044018323999999998, 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8810 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982818+0000", 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4699999999999998e-07 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982819+0000", 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982822+0000", 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2679999999999999e-06 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982825+0000", 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5469999999999999e-06 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026671+0000", 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043846663000000001 2024-09-14T07:12:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026744+0000", 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2267000000000005e-05 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026836+0000", 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2280000000000004e-05 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8811 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1597440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2656239349999998, 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044155904000000003, 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8811 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982828+0000", 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.22e-07 2024-09-14T07:12:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982829+0000", 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4900000000000005e-07 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982832+0000", 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9380000000000001e-06 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982837+0000", 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7540000000000003e-06 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026877+0000", 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044039578000000003 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026917+0000", 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0089999999999997e-05 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.026984+0000", 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6472999999999999e-05 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8812 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1638400~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2656085240000001, 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044336475, 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8812 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982843+0000", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5699999999999998e-07 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982845+0000", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6309999999999999e-06 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982851+0000", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6149999999999996e-06 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982855+0000", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4939999999999997e-06 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027020+0000", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044164634000000001 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027090+0000", 2024-09-14T07:12:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0549000000000005e-05 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027180+0000", 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9195000000000002e-05 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8813 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1691648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.982861+0000", 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2655902460000004, 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044560297999999998, 2024-09-14T07:12:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8813 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982861+0000", 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.982861+0000", 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983162+0000", 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030031399999999998 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983165+0000", 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.642e-06 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983172+0000", 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0299999999999996e-06 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983181+0000", 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0329999999999997e-06 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027220+0000", 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044038881000000002 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027303+0000", 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2633999999999995e-05 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027422+0000", 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118764 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8814 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1732608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2652611020000002, 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044358841000000003, 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8814 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983191+0000", 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9400000000000001e-07 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983192+0000", 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2160000000000001e-06 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983197+0000", 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4710000000000001e-06 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983199+0000", 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7839999999999999e-06 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027460+0000", 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044260509000000003 2024-09-14T07:12:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027506+0000", 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5768e-05 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027549+0000", 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3798999999999999e-05 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8815 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1773568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983203+0000", 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2652486710000002, 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044495282999999997, 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8815 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983203+0000", 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983203+0000", 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983947+0000", 2024-09-14T07:12:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074430799999999995 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983951+0000", 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7100000000000001e-06 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983960+0000", 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.465e-06 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983967+0000", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4540000000000004e-06 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027579+0000", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043612138000000002 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027636+0000", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7083999999999998e-05 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027698+0000", 2024-09-14T07:12:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2124000000000004e-05 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8816 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1826816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983991+0000", 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2644604939999997, 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043911048000000001, 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8816 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983991+0000", 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983991+0000", 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983992+0000", 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0299999999999997e-07 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983996+0000", 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8519999999999997e-06 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984009+0000", 2024-09-14T07:12:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2917e-05 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984014+0000", 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2299999999999999e-06 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027743+0000", 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043728744999999999 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027823+0000", 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9826000000000004e-05 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027902+0000", 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9574999999999996e-05 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8817 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1867776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.264427725, 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044076771000000001, 2024-09-14T07:12:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8817 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984024+0000", 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984026+0000", 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.796e-06 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984031+0000", 2024-09-14T07:12:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9080000000000003e-06 2024-09-14T07:12:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984034+0000", 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9349999999999999e-06 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027953+0000", 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043918647999999998 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028032+0000", 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9668999999999999e-05 2024-09-14T07:12:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028101+0000", 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-05 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8818 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2644135749999998, 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044195990999999997, 2024-09-14T07:12:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8818 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984038+0000", 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984039+0000", 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.119e-06 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984043+0000", 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2899999999999998e-06 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984045+0000", 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7350000000000001e-06 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028124+0000", 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044078820999999997 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028175+0000", 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0782999999999998e-05 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028234+0000", 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9018000000000003e-05 2024-09-14T07:12:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8819 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 1961984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984049+0000", 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2644022399999999, 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044338322999999999, 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8819 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984049+0000", 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984049+0000", 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984224+0000", 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017466000000000001 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984236+0000", 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1956e-05 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984246+0000", 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0247e-05 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984252+0000", 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1909999999999997e-06 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028265+0000", 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044012453999999999 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028347+0000", 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1963000000000001e-05 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028388+0000", 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0852000000000001e-05 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8820 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 2002944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984263+0000", 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2641885879999997, 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044238078, 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8820 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984263+0000", 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984263+0000", 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984435+0000", 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172072 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984440+0000", 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3129999999999998e-06 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984458+0000", 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984466+0000", 2024-09-14T07:12:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9109999999999993e-06 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028413+0000", 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043946458000000001 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028464+0000", 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.092e-05 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028501+0000", 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7620000000000002e-05 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8821 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984480+0000", 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2639718100000001, 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044133740999999997, 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8821 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984480+0000", 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984480+0000", 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984631+0000", 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000151285 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984635+0000", 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9620000000000004e-06 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984643+0000", 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6000000000000001e-06 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984648+0000", 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4090000000000002e-06 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028526+0000", 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043877712999999999 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028572+0000", 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6365000000000001e-05 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028614+0000", 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1406999999999998e-05 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8885 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 32768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984659+0000", 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2637924399999996, 2024-09-14T07:12:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044073761000000003, 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8885 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984659+0000", 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984659+0000", 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984815+0000", 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015580100000000001 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984819+0000", 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5710000000000002e-06 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984827+0000", 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5690000000000005e-06 2024-09-14T07:12:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984847+0000", 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0034000000000002e-05 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028643+0000", 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043795331999999999 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028679+0000", 2024-09-14T07:12:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6910999999999999e-05 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028733+0000", 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3542999999999999e-05 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8886 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.984859+0000", 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2635925800000001, 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044065757999999997, 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8886 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984859+0000", 2024-09-14T07:12:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.984859+0000", 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985000+0000", 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141058 2024-09-14T07:12:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985004+0000", 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6150000000000001e-06 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985013+0000", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2e-06 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985019+0000", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028757+0000", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043737972 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028819+0000", 2024-09-14T07:12:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1940000000000007e-05 2024-09-14T07:12:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028925+0000", 2024-09-14T07:12:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105672 2024-09-14T07:12:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8887 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 126976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985031+0000", 2024-09-14T07:12:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2634201789999997, 2024-09-14T07:12:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044058517999999998, 2024-09-14T07:12:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8887 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985031+0000", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985031+0000", 2024-09-14T07:12:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985261+0000", 2024-09-14T07:12:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022976800000000001 2024-09-14T07:12:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985271+0000", 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4269999999999997e-06 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985280+0000", 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0420000000000008e-06 2024-09-14T07:12:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985285+0000", 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.899e-06 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028984+0000", 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043699256999999998 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029033+0000", 2024-09-14T07:12:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9319e-05 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029090+0000", 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6805999999999998e-05 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8888 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 167936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985295+0000", 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2631562350000003, 2024-09-14T07:12:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044007486999999998, 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8888 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985295+0000", 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985295+0000", 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985460+0000", 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164587 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985465+0000", 2024-09-14T07:12:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6419999999999998e-06 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985475+0000", 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0298e-05 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985482+0000", 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.092e-06 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029126+0000", 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043644027000000002 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029215+0000", 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8938999999999997e-05 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029303+0000", 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7902e-05 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8889 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 208896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985495+0000", 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2629569070000004, 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043927473000000002, 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8889 2024-09-14T07:12:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985495+0000", 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985495+0000", 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985569+0000", 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4201000000000003e-05 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985572+0000", 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.309e-06 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985581+0000", 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1560000000000001e-06 2024-09-14T07:12:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985588+0000", 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2230000000000004e-06 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029318+0000", 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043729927000000002 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029372+0000", 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4700999999999997e-05 2024-09-14T07:12:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029422+0000", 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9956000000000001e-05 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8890 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 303104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985597+0000", 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2628545569999998, 2024-09-14T07:12:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044030518999999997, 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8890 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985597+0000", 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985597+0000", 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985834+0000", 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023693600000000001 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985845+0000", 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1246e-05 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985855+0000", 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8500000000000006e-06 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985867+0000", 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1735e-05 2024-09-14T07:12:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029464+0000", 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043597612000000001 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029537+0000", 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2052999999999996e-05 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029628+0000", 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1087000000000004e-05 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8891 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 344064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.985879+0000", 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2625722420000001, 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043845596000000001, 2024-09-14T07:12:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8891 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985879+0000", 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.985879+0000", 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986057+0000", 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017764500000000001 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986062+0000", 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7589999999999997e-06 2024-09-14T07:12:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986073+0000", 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1232e-05 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986079+0000", 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029642+0000", 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043563604999999998 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029679+0000", 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6566999999999997e-05 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.029725+0000", 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6291000000000001e-05 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:8894 3.19 3:9a10d6ec:::rbd_data.1182823d0fd0.0000000000000000:6 [read 573440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.986397+0000", 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2620544450000004, 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043837460000000002, 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8894 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986397+0000", 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986397+0000", 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986600+0000", 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000203179 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986614+0000", 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3504e-05 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986631+0000", 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6679000000000001e-05 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.986640+0000", 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4660000000000005e-06 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.030059+0000", 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.043418934999999999 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.030140+0000", 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1223999999999993e-05 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.030235+0000", 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4473000000000002e-05 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.345 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:11.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:11.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:11.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:11.348 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:11.348 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:11.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:11.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:11.349 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:11.350 INFO:teuthology.orchestra.run.smithi071.stdout:1289 read 0x3aede5 thru 0x3af1ff (0x41b bytes) 2024-09-14T07:12:11.350 INFO:teuthology.orchestra.run.smithi071.stdout:1290 punch from 0xdb159 to 0xdf712, (0x45b9 bytes) 2024-09-14T07:12:11.350 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:11.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:11.351 INFO:teuthology.orchestra.run.smithi071.stdout:1293 write 0xc1709e9 thru 0xc179196 (0x87ae bytes) 2024-09-14T07:12:11.351 INFO:teuthology.orchestra.run.smithi071.stdout:1294 read 0x2a4fcbb thru 0x2a58c10 (0x8f56 bytes) 2024-09-14T07:12:11.351 INFO:teuthology.orchestra.run.smithi071.stdout:1295 write 0x8371f9f thru 0x8377ef7 (0x5f59 bytes) 2024-09-14T07:12:11.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:11.352 INFO:teuthology.orchestra.run.smithi071.stdout:1296 punch from 0x2ee8d86 to 0x2eefa15, (0x6c8f bytes) 2024-09-14T07:12:11.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:11.352 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.353 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.353 INFO:teuthology.orchestra.run.smithi071.stdout:1300 punch from 0x8140afe to 0x8147533, (0x6a35 bytes) 2024-09-14T07:12:11.353 INFO:teuthology.orchestra.run.smithi071.stdout:1301 write 0x2a5aaf3 thru 0x2a5e66e (0x3b7c bytes) 2024-09-14T07:12:11.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:11.354 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:11.354 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:11.346+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:11.363 INFO:teuthology.orchestra.run.smithi071.stdout:1302 write 0xd339445 thru 0xd348527 (0xf0e3 bytes) 2024-09-14T07:12:11.366 INFO:teuthology.orchestra.run.smithi071.stdout:1305 write 0x54bf6eb thru 0x54c7497 (0x7dad bytes) 2024-09-14T07:12:11.383 INFO:teuthology.orchestra.run.smithi071.stdout:1306 trunc from 0xd348528 to 0x431a9d1 2024-09-14T07:12:11.411 INFO:teuthology.orchestra.run.smithi071.stdout:1308 write 0xdefe8c1 thru 0xdf080c3 (0x9803 bytes) 2024-09-14T07:12:11.414 INFO:teuthology.orchestra.run.smithi071.stdout:1311 write 0xdc94931 thru 0xdc9d01b (0x86eb bytes) 2024-09-14T07:12:11.417 INFO:teuthology.orchestra.run.smithi071.stdout:1312 read 0x2e32e9f thru 0x2e39b7a (0x6cdc bytes) 2024-09-14T07:12:11.417 INFO:teuthology.orchestra.run.smithi071.stdout:1314 read 0xcaa86d7 thru 0xcab67a8 (0xe0d2 bytes) 2024-09-14T07:12:11.420 INFO:teuthology.orchestra.run.smithi071.stdout:1315 trunc from 0xdf080c4 to 0xb602c75 2024-09-14T07:12:11.434 INFO:teuthology.orchestra.run.smithi071.stdout:1317 write 0xd305f57 thru 0xd30939b (0x3445 bytes) 2024-09-14T07:12:11.436 INFO:teuthology.orchestra.run.smithi071.stdout:1319 write 0x8b11d6f thru 0x8b1a6f4 (0x8986 bytes) 2024-09-14T07:12:11.440 INFO:teuthology.orchestra.run.smithi071.stdout:1320 trunc from 0xd30939c to 0xbcb0ce9 2024-09-14T07:12:11.448 INFO:teuthology.orchestra.run.smithi071.stdout:1321 read 0xb8d6397 thru 0xb8d9411 (0x307b bytes) 2024-09-14T07:12:11.448 INFO:teuthology.orchestra.run.smithi071.stdout:1322 read 0x4e5cb8c thru 0x4e66f63 (0xa3d8 bytes) 2024-09-14T07:12:11.448 INFO:teuthology.orchestra.run.smithi071.stdout:1323 read 0x43f8fa1 thru 0x440600f (0xd06f bytes) 2024-09-14T07:12:11.448 INFO:teuthology.orchestra.run.smithi071.stdout:1324 punch from 0xa5644da to 0xa570057, (0xbb7d bytes) 2024-09-14T07:12:11.448 INFO:teuthology.orchestra.run.smithi071.stdout:1325 read 0x7545c64 thru 0x7552c76 (0xd013 bytes) 2024-09-14T07:12:11.448 INFO:teuthology.orchestra.run.smithi071.stdout:1326 write 0xa3b6a2c thru 0xa3bcf80 (0x6555 bytes) 2024-09-14T07:12:11.449 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:11.447+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:11.449 INFO:teuthology.orchestra.run.smithi071.stdout:1327 read 0x398cee8 thru 0x3998e90 (0xbfa9 bytes) 2024-09-14T07:12:11.449 INFO:teuthology.orchestra.run.smithi071.stdout:1328 write 0x63157e2 thru 0x6320d69 (0xb588 bytes) 2024-09-14T07:12:11.458 INFO:teuthology.orchestra.run.smithi071.stdout:1329 writesame 0xd019e8b thru 0xd021112 data_size 0x14(0x7288 bytes) 2024-09-14T07:12:11.458 INFO:teuthology.orchestra.run.smithi071.stdout:1330 read 0x22bc532 thru 0x22c47b6 (0x8285 bytes) 2024-09-14T07:12:11.458 INFO:teuthology.orchestra.run.smithi071.stdout:1331 punch from 0x4ae3afd to 0x4ae7fb9, (0x44bc bytes) 2024-09-14T07:12:11.465 INFO:teuthology.orchestra.run.smithi071.stdout:1333 write 0xec23096 thru 0xec2cc79 (0x9be4 bytes) 2024-09-14T07:12:11.469 INFO:teuthology.orchestra.run.smithi071.stdout:1334 read 0x2967d12 thru 0x2969ed7 (0x21c6 bytes) 2024-09-14T07:12:11.469 INFO:teuthology.orchestra.run.smithi071.stdout:1335 read 0x3912ebb thru 0x391690c (0x3a52 bytes) 2024-09-14T07:12:11.470 INFO:teuthology.orchestra.run.smithi071.stdout:1337 write 0xcdcd222 thru 0xcdcf5ee (0x23cd bytes) 2024-09-14T07:12:11.471 INFO:teuthology.orchestra.run.smithi071.stdout:1338 read 0x58c9581 thru 0x58d6c55 (0xd6d5 bytes) 2024-09-14T07:12:11.471 INFO:teuthology.orchestra.run.smithi071.stdout:1339 read 0x335b62f thru 0x3361c8e (0x6660 bytes) 2024-09-14T07:12:11.471 INFO:teuthology.orchestra.run.smithi071.stdout:1340 punch from 0x43d3ff to 0x444f04, (0x7b05 bytes) 2024-09-14T07:12:11.472 INFO:teuthology.orchestra.run.smithi071.stdout:1341 punch from 0x71c8e20 to 0x71d5c2d, (0xce0d bytes) 2024-09-14T07:12:11.472 INFO:teuthology.orchestra.run.smithi071.stdout:1342 writesame 0xbe20c7c thru 0xbe2cf55 data_size 0x7(0xc2da bytes) 2024-09-14T07:12:11.485 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:11.485 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:11.485 INFO:teuthology.orchestra.run.smithi071.stdout:1343 trunc from 0xec2cc7a to 0x5f694e9 2024-09-14T07:12:11.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:11.498 INFO:teuthology.orchestra.run.smithi071.stdout:1344 punch from 0x2f7f4d0 to 0x2f81029, (0x1b59 bytes) 2024-09-14T07:12:11.498 INFO:teuthology.orchestra.run.smithi071.stdout:1345 punch from 0x37fd5ca to 0x380956c, (0xbfa2 bytes) 2024-09-14T07:12:11.514 INFO:teuthology.orchestra.run.smithi071.stdout:1346 write 0xe223ed5 thru 0xe22b592 (0x76be bytes) 2024-09-14T07:12:11.529 INFO:teuthology.orchestra.run.smithi071.stdout:1347 trunc from 0xe22b593 to 0x4097ed5 2024-09-14T07:12:11.548 INFO:teuthology.orchestra.run.smithi071.stdout:1349 writesame 0x68fc3b0 thru 0x69009a3 data_size 0x16(0x45f4 bytes) 2024-09-14T07:12:11.548 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:11.547+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:11.563 INFO:teuthology.orchestra.run.smithi071.stdout:1350 writesame 0xe8e8fc7 thru 0xe8f5c6f data_size 0xb(0xcca9 bytes) 2024-09-14T07:12:11.563 INFO:teuthology.orchestra.run.smithi071.stdout:1351 read 0x41e58a5 thru 0x41f3ac2 (0xe21e bytes) 2024-09-14T07:12:11.564 INFO:teuthology.orchestra.run.smithi071.stdout:1352 writesame 0x62561d5 thru 0x625e9ca data_size 0x3(0x87f6 bytes) 2024-09-14T07:12:11.570 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.570 INFO:teuthology.orchestra.run.smithi071.stdout:1355 punch from 0xab33038 to 0xab398f6, (0x68be bytes) 2024-09-14T07:12:11.570 INFO:teuthology.orchestra.run.smithi071.stdout:1356 writesame 0xa3dabe1 thru 0xa3e186a data_size 0xb(0x6c8a bytes) 2024-09-14T07:12:11.573 INFO:teuthology.orchestra.run.smithi071.stdout:1357 read 0xabc5b58 thru 0xabccf17 (0x73c0 bytes) 2024-09-14T07:12:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:1361 read 0xe2e2319 thru 0xe2f2174 (0xfe5c bytes) 2024-09-14T07:12:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:1363 read 0x90995ae thru 0x90a1353 (0x7da6 bytes) 2024-09-14T07:12:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:1364 punch from 0x3aef46c to 0x3af345b, (0x3fef bytes) 2024-09-14T07:12:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:1365 punch from 0xc44480d to 0xc44972e, (0x4f21 bytes) 2024-09-14T07:12:11.574 INFO:teuthology.orchestra.run.smithi071.stdout:1366 write 0xc0952ca thru 0xc0967d3 (0x150a bytes) 2024-09-14T07:12:11.577 INFO:teuthology.orchestra.run.smithi071.stdout:1368 punch from 0x746c027 to 0x7476877, (0xa850 bytes) 2024-09-14T07:12:11.577 INFO:teuthology.orchestra.run.smithi071.stdout:1369 read 0xabebc4a thru 0xabf9573 (0xd92a bytes) 2024-09-14T07:12:11.577 INFO:teuthology.orchestra.run.smithi071.stdout:1370 read 0x152c009 thru 0x1536d2a (0xad22 bytes) 2024-09-14T07:12:11.577 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.577 INFO:teuthology.orchestra.run.smithi071.stdout:1372 writesame 0x3389620 thru 0x33956e7 data_size 0x7c(0xc0c8 bytes) 2024-09-14T07:12:11.593 INFO:teuthology.orchestra.run.smithi071.stdout:1373 write 0x3938481 thru 0x3942f05 (0xaa85 bytes) 2024-09-14T07:12:11.594 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.594 INFO:teuthology.orchestra.run.smithi071.stdout:1375 read 0x5d77bb8 thru 0x5d850f7 (0xd540 bytes) 2024-09-14T07:12:11.594 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.594 INFO:teuthology.orchestra.run.smithi071.stdout:1377 write 0xcfe536f thru 0xcfef250 (0x9ee2 bytes) 2024-09-14T07:12:11.597 INFO:teuthology.orchestra.run.smithi071.stdout:1378 punch from 0x1a01fce to 0x1a0998b, (0x79bd bytes) 2024-09-14T07:12:11.597 INFO:teuthology.orchestra.run.smithi071.stdout:1379 read 0x683777 thru 0x68a01a (0x68a4 bytes) 2024-09-14T07:12:11.597 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.597 INFO:teuthology.orchestra.run.smithi071.stdout:1381 read 0x8b1c7e3 thru 0x8b2c2a6 (0xfac4 bytes) 2024-09-14T07:12:11.602 INFO:teuthology.orchestra.run.smithi071.stdout:1382 trunc from 0xe8f5c70 to 0xa6d432a 2024-09-14T07:12:11.620 INFO:teuthology.orchestra.run.smithi071.stdout:1386 write 0xc7c9a3d thru 0xc7d85d4 (0xeb98 bytes) 2024-09-14T07:12:11.621 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:11.621 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:11.623 INFO:teuthology.orchestra.run.smithi071.stdout:1387 flatten 2024-09-14T07:12:11.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:11.662 INFO:teuthology.orchestra.run.smithi071.stdout:1388 write 0x1b412f8 thru 0x1b44846 (0x354f bytes) 2024-09-14T07:12:11.663 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:11.661+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:11.665 INFO:teuthology.orchestra.run.smithi071.stdout:1390 write 0xd5e155 thru 0xd60ece (0x2d7a bytes) 2024-09-14T07:12:11.667 INFO:teuthology.orchestra.run.smithi071.stdout:1391 punch from 0xa01e49 to 0xa0366a, (0x1821 bytes) 2024-09-14T07:12:11.667 INFO:teuthology.orchestra.run.smithi071.stdout:1392 punch from 0x7253662 to 0x72589ef, (0x538d bytes) 2024-09-14T07:12:11.667 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:11.667 INFO:teuthology.orchestra.run.smithi071.stdout:1395 write 0x53bb571 thru 0x53be383 (0x2e13 bytes) 2024-09-14T07:12:11.668 INFO:teuthology.orchestra.run.smithi071.stdout:1396 write 0xb763b56 thru 0xb76fe27 (0xc2d2 bytes) 2024-09-14T07:12:11.671 INFO:teuthology.orchestra.run.smithi071.stdout:1397 read 0x7950300 thru 0x7959684 (0x9385 bytes) 2024-09-14T07:12:11.671 INFO:teuthology.orchestra.run.smithi071.stdout:1398 write 0x952830d thru 0x95325eb (0xa2df bytes) 2024-09-14T07:12:11.673 INFO:teuthology.orchestra.run.smithi071.stdout:1399 writesame 0xc72bab4 thru 0xc73539e data_size 0x1(0x98eb bytes) 2024-09-14T07:12:11.688 INFO:teuthology.orchestra.run.smithi071.stdout:1400 write 0x8018962 thru 0x80215b7 (0x8c56 bytes) 2024-09-14T07:12:11.689 INFO:teuthology.orchestra.run.smithi071.stdout:1401 punch from 0x26630c0 to 0x26710ea, (0xe02a bytes) 2024-09-14T07:12:11.697 INFO:teuthology.orchestra.run.smithi071.stdout:1403 writesame 0xdb712ea thru 0xdb7a0f3 data_size 0x1(0x8e0a bytes) 2024-09-14T07:12:11.697 INFO:teuthology.orchestra.run.smithi071.stdout:1404 write 0x653a200 thru 0x6549c0f (0xfa10 bytes) 2024-09-14T07:12:11.700 INFO:teuthology.orchestra.run.smithi071.stdout:1405 write 0xaf77c65 thru 0xaf7cb10 (0x4eac bytes) 2024-09-14T07:12:11.701 INFO:teuthology.orchestra.run.smithi071.stdout:1407 writesame 0xb053514 thru 0xb0543b0 data_size 0x3(0xe9d bytes) 2024-09-14T07:12:11.705 INFO:teuthology.orchestra.run.smithi071.stdout:1408 trunc from 0xdb7a0f4 to 0xad27171 2024-09-14T07:12:11.712 INFO:teuthology.orchestra.run.smithi071.stdout:1409 writesame 0x377c7c1 thru 0x377ec2b data_size 0x1(0x246b bytes) 2024-09-14T07:12:11.717 INFO:teuthology.orchestra.run.smithi071.stdout:1410 read 0x8ed13fa thru 0x8ed7939 (0x6540 bytes) 2024-09-14T07:12:11.718 INFO:teuthology.orchestra.run.smithi071.stdout:1412 trunc from 0xad27171 to 0xa3ea230 2024-09-14T07:12:11.729 INFO:teuthology.orchestra.run.smithi071.stdout:1414 read 0x1a3cc4d thru 0x1a4b473 (0xe827 bytes) 2024-09-14T07:12:11.729 INFO:teuthology.orchestra.run.smithi071.stdout:1415 read 0x373e781 thru 0x3743322 (0x4ba2 bytes) 2024-09-14T07:12:11.730 INFO:teuthology.orchestra.run.smithi071.stdout:1416 punch from 0x2e919b9 to 0x2e98941, (0x6f88 bytes) 2024-09-14T07:12:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:12:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:1417 writesame 0xd833446 thru 0xd83f355 data_size 0x18(0xbf10 bytes) 2024-09-14T07:12:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:1419 punch from 0xb62aea4 to 0xb633bcc, (0x8d28 bytes) 2024-09-14T07:12:11.749 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:11.749+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:11.760 INFO:teuthology.orchestra.run.smithi071.stdout:1420 trunc from 0xd83f356 to 0x1b69abf 2024-09-14T07:12:11.774 INFO:teuthology.orchestra.run.smithi071.stdout:1421 read 0x1505752 thru 0x15153ab (0xfc5a bytes) 2024-09-14T07:12:11.775 INFO:teuthology.orchestra.run.smithi071.stdout:1422 clone 12 order 21 su 262144 sc 8 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1047 3.0 e28/23 3:06cd0b7a:::rbd_data.11822ba09815.0000000000000006:head v 28'8, mlcod=28'6)", 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:12:11.787 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.593238972, 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010714940000000001, 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192814+0000", 2024-09-14T07:12:11.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192816+0000", 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.46e-06 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192872+0000", 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6079000000000003e-05 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192890+0000", 2024-09-14T07:12:11.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7873e-05 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192899+0000", 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1200000000000008e-06 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192965+0000", 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5675999999999999e-05 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.192990+0000", 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5072999999999999e-05 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.193856+0000", 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086668300000000004 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.193886+0000", 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.953e-05 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1286 3.0 e29/23 3:06cd0b7a:::rbd_data.11822ba09815.0000000000000006:head v 29'10, mlcod=28'7)", 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.029407711999999, 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011381449999999999, 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756646+0000", 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2800000000000003e-07 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756659+0000", 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101999999999999e-05 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756667+0000", 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8080000000000005e-06 2024-09-14T07:12:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756675+0000", 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7139999999999993e-06 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756755+0000", 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9999000000000004e-05 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.756780+0000", 2024-09-14T07:12:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5452e-05 2024-09-14T07:12:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.757741+0000", 2024-09-14T07:12:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096068200000000003 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.757784+0000", 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3059999999999998e-05 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1290 3.0 e29/23 3:05098d9c:::rbd_data.11822ba09815.0000000000000004:head v 29'11, mlcod=28'8)", 2024-09-14T07:12:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.759820+0000", 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.026233320999999, 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001887428, 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759820+0000", 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759820+0000", 2024-09-14T07:12:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759821+0000", 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3200000000000004e-07 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759858+0000", 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7228000000000003e-05 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759874+0000", 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6175e-05 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759883+0000", 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2609999999999993e-06 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759944+0000", 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1100999999999997e-05 2024-09-14T07:12:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.759963+0000", 2024-09-14T07:12:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9499000000000001e-05 2024-09-14T07:12:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761667+0000", 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001703644 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.761707+0000", 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0688000000000001e-05 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:1291 3.0 e29/23 3:05098d9c:::rbd_data.11822ba09815.0000000000000004:head v 29'13, mlcod=28'8)", 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:58.760753+0000", 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.025300040999999, 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013568289999999999, 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760753+0000", 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760753+0000", 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760754+0000", 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5099999999999999e-07 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760761+0000", 2024-09-14T07:12:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5320000000000003e-06 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760773+0000", 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.271e-05 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760782+0000", 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5990000000000002e-06 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760851+0000", 2024-09-14T07:12:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8826999999999997e-05 2024-09-14T07:12:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.760874+0000", 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3235e-05 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762072+0000", 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011978679999999999 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:58.762110+0000", 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8306999999999998e-05 2024-09-14T07:12:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:2530 3.9 e30/23 3:97f66fbb:::rbd_data.1182823d0fd0.000000000000001e:head v 30'5, mlcod=29'3)", 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.018085538999999, 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010146459999999999, 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767968+0000", 2024-09-14T07:12:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8599999999999999e-07 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767973+0000", 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7029999999999997e-06 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.767993+0000", 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9811999999999999e-05 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768001+0000", 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7150000000000004e-06 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768063+0000", 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1329999999999997e-05 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768084+0000", 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.177e-05 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768944+0000", 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085967499999999996 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:11:59.768982+0000", 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355000000000001e-05 2024-09-14T07:12:11.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7823 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'32, mlcod=32'30)", 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0533286529999994, 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020025759999999998, 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732726+0000", 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6799999999999999e-07 2024-09-14T07:12:11.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732731+0000", 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6119999999999998e-06 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732742+0000", 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.093e-05 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732748+0000", 2024-09-14T07:12:11.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4990000000000002e-06 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732790+0000", 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531000000000003e-05 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732803+0000", 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3135999999999999e-05 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734693+0000", 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889967 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734727+0000", 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4032999999999998e-05 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7838 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'34, mlcod=34'32)", 2024-09-14T07:12:11.820 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0417976309999997, 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00194644, 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744257+0000", 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0100000000000004e-07 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744263+0000", 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2779999999999999e-06 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744276+0000", 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3335e-05 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744283+0000", 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8750000000000002e-06 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744328+0000", 2024-09-14T07:12:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5000999999999998e-05 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744348+0000", 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0239000000000001e-05 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746170+0000", 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018221859999999999 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746202+0000", 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1724999999999999e-05 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7864 3.9 e34/23 3:9662e057:::rbd_data.1182a7d91484.0000000000000022:head v 34'31, mlcod=32'28)", 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0257394620000007, 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020061520000000002, 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.825 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760325+0000", 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0907000000000001e-05 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760333+0000", 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2150000000000001e-06 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760348+0000", 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5026e-05 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760405+0000", 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6885999999999997e-05 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760426+0000", 2024-09-14T07:12:11.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0265e-05 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762272+0000", 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001846349 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762320+0000", 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8106000000000003e-05 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7866 3.4 e34/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:head v 34'37, mlcod=34'34)", 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.023814797, 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026596739999999999, 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762266+0000", 2024-09-14T07:12:11.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7076e-05 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762280+0000", 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4004e-05 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762288+0000", 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.678e-06 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762339+0000", 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0430000000000003e-05 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762357+0000", 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8850000000000001e-05 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764858+0000", 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004010000000002 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764898+0000", 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0414000000000003e-05 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0191902000000006, 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:11.834 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:11.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0180913109999992, 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:11.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:11.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7905 3.4 e34/23 3:20b4893f:::rbd_data.1182a7d91484.0000000000000013:head v 34'39, mlcod=34'35)", 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.9939018979999998, 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00219133, 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792152+0000", 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792161+0000", 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3809999999999999e-06 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792177+0000", 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5838e-05 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792185+0000", 2024-09-14T07:12:11.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9400000000000002e-06 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792248+0000", 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2928000000000005e-05 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792268+0000", 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0404999999999999e-05 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794300+0000", 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020316819999999999 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794343+0000", 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3183999999999999e-05 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:11.848 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9912481519999998, 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12482 3.0 e37/23 3:04a1ed04:::rbd_data.1182a59bd9ad.0000000000000028:head v 37'42, mlcod=37'39)", 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7044381450000001, 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028333389999999998, 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081616+0000", 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7300000000000005e-07 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081622+0000", 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081638+0000", 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6429000000000001e-05 2024-09-14T07:12:11.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081646+0000", 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.622e-06 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081706+0000", 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9840000000000003e-05 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081724+0000", 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8150000000000001e-05 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084410+0000", 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026862029999999999 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084449+0000", 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8342e-05 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12712 3.0 e38/23 3:01cc77df:::rbd_header.1182c19f8219:head v 38'47, mlcod=38'45)", 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.790264+0000", 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9957890750000002, 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001886551, 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790264+0000", 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790264+0000", 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790265+0000", 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5799999999999999e-07 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790274+0000", 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6729999999999998e-06 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790285+0000", 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.115e-05 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790291+0000", 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3720000000000001e-06 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790336+0000", 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4629000000000002e-05 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.790353+0000", 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7476999999999999e-05 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.792092+0000", 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739186 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.792151+0000", 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8406000000000003e-05 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9779541470000002, 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:11.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9778847329999998, 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:11.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:11.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12757 3.9 e38/23 3:908f411a:::rbd_data.1182a59bd9ad.0000000000000009:head v 38'100, mlcod=37'97)", 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.824498+0000", 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9615550929999999, 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001035565, 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824498+0000", 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824498+0000", 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824500+0000", 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.339e-06 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824509+0000", 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8630000000000003e-06 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824527+0000", 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7929000000000001e-05 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824537+0000", 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8630000000000003e-06 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824602+0000", 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4375999999999995e-05 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.824623+0000", 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1223e-05 2024-09-14T07:12:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.825505+0000", 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088168100000000004 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.825534+0000", 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9291000000000001e-05 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:16319 3.0 e41/23 3:012d8706:::rbd_data.11826f680556.0000000000000022:head v 41'83, mlcod=41'80)", 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.488814+0000", 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.29723976400000002, 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013518580000000001, 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488814+0000", 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488814+0000", 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488814+0000", 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5300000000000004e-07 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488819+0000", 2024-09-14T07:12:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9679999999999997e-06 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488828+0000", 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3720000000000005e-06 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488834+0000", 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0179999999999998e-06 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488888+0000", 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3999999999999998e-05 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.488907+0000", 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9508999999999999e-05 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.490134+0000", 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001226455 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.490165+0000", 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1883e-05 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.13750670800000001, 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:11.885 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:11.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:11.887 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:11.885+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:11.987 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:11.986+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:12.031 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:12.031 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:12.031 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:12.031 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:12.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:12.088 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:12.088+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:12.141 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:12.141 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:12.141 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:12.141 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:12.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:12.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:12.189 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:12.188+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:12.253 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9261 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 806912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983608+0000", 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2687380289999997, 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035550126000000001, 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9261 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983608+0000", 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983608+0000", 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983609+0000", 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2300000000000002e-07 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983611+0000", 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0030000000000001e-06 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983618+0000", 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5390000000000002e-06 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983624+0000", 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5550000000000002e-06 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019019+0000", 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035394854000000003 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019091+0000", 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1823999999999995e-05 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019158+0000", 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7928000000000004e-05 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9263 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 901120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983631+0000", 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2687153349999996, 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035696906, 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9263 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.259 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983631+0000", 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983631+0000", 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983632+0000", 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:12:12.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983634+0000", 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.996e-06 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983640+0000", 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3239999999999999e-06 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983645+0000", 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0350000000000001e-06 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019200+0000", 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035555152 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019261+0000", 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0659999999999999e-05 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019328+0000", 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7246e-05 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9265 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 942080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983652+0000", 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2686947849999992, 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035798253000000002, 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9265 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983652+0000", 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983652+0000", 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983652+0000", 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9000000000000002e-07 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983654+0000", 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8670000000000001e-06 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983660+0000", 2024-09-14T07:12:12.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1720000000000004e-06 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983663+0000", 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9229999999999998e-06 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019362+0000", 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035699413999999999 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019408+0000", 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5952999999999999e-05 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019450+0000", 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9266 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983675+0000", 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2686709989999994, 2024-09-14T07:12:12.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035897960999999999, 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9266 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983675+0000", 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983675+0000", 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983676+0000", 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983678+0000", 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983682+0000", 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4329999999999997e-06 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983686+0000", 2024-09-14T07:12:12.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019470+0000", 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035783658000000003 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019531+0000", 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0859000000000001e-05 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019573+0000", 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2391000000000001e-05 2024-09-14T07:12:12.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9268 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1036288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983710+0000", 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2686366679999992, 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036055120000000003, 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9268 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983710+0000", 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983710+0000", 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983710+0000", 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5499999999999998e-07 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983719+0000", 2024-09-14T07:12:12.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9930000000000001e-06 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983727+0000", 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2089999999999999e-06 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983732+0000", 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2519999999999999e-06 2024-09-14T07:12:12.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019612+0000", 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035879998000000003 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019689+0000", 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.682e-05 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019765+0000", 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6192999999999994e-05 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9270 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1077248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983740+0000", 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2686068949999996, 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036229632999999997, 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9270 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983740+0000", 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983740+0000", 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983740+0000", 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5999999999999999e-07 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983742+0000", 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9609999999999999e-06 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983748+0000", 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1829999999999999e-06 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983753+0000", 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7330000000000003e-06 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019806+0000", 2024-09-14T07:12:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036052710000000002 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019883+0000", 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309000000000001e-05 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.019969+0000", 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6277000000000001e-05 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9272 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1118208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983760+0000", 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2685867949999992, 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036392273000000003, 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9272 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983760+0000", 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983760+0000", 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983760+0000", 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0600000000000001e-07 2024-09-14T07:12:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983762+0000", 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.905e-06 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983768+0000", 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1190000000000002e-06 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983773+0000", 2024-09-14T07:12:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.69e-06 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020008+0000", 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036235745 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020082+0000", 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3391000000000003e-05 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020152+0000", 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0017000000000004e-05 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9274 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1171456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983779+0000", 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2685669980000007, 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036564744000000003, 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9274 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983779+0000", 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983779+0000", 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983780+0000", 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8700000000000001e-07 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983782+0000", 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9800000000000001e-06 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983788+0000", 2024-09-14T07:12:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983793+0000", 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6469999999999997e-06 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020185+0000", 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036392806999999999 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020261+0000", 2024-09-14T07:12:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5579000000000003e-05 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020344+0000", 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3178999999999998e-05 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9275 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1212416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983799+0000", 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2685475119999996, 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036720237000000003, 2024-09-14T07:12:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9275 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983799+0000", 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983799+0000", 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983799+0000", 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983801+0000", 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.792e-06 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983807+0000", 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983812+0000", 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4700000000000004e-06 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020381+0000", 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036569463000000003 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020450+0000", 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8905999999999994e-05 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020519+0000", 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9041999999999994e-05 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9276 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1253376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983829+0000", 2024-09-14T07:12:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2685175120000007, 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036816434000000002, 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9276 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983829+0000", 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983829+0000", 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983829+0000", 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0200000000000002e-07 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983832+0000", 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2709999999999999e-06 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983839+0000", 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9430000000000003e-06 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983843+0000", 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.685e-06 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020560+0000", 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036716713999999998 2024-09-14T07:12:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020606+0000", 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5590999999999998e-05 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020645+0000", 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9728000000000003e-05 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9278 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1306624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.983850+0000", 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2684960929999995, 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036893211000000002, 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9278 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983850+0000", 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983850+0000", 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983851+0000", 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.91e-07 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983852+0000", 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.28e-06 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983857+0000", 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7439999999999998e-06 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.983860+0000", 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2100000000000002e-06 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020669+0000", 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.03680887 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020704+0000", 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4894000000000002e-05 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.020744+0000", 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9922000000000002e-05 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9439 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 819200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992068+0000", 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2602782769999994, 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035513894999999997, 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9439 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992068+0000", 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992068+0000", 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992069+0000", 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992074+0000", 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5979999999999999e-06 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992085+0000", 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1398e-05 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992091+0000", 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3810000000000004e-06 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027467+0000", 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035375173000000003 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027525+0000", 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8130000000000001e-05 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027582+0000", 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7340999999999999e-05 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9440 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 860160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.307 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992109+0000", 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2602376849999999, 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035588759999999997, 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9440 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992109+0000", 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992109+0000", 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992109+0000", 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992111+0000", 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.807e-06 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992115+0000", 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4889999999999997e-06 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992120+0000", 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3810000000000001e-06 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027608+0000", 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0354883 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027654+0000", 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5980999999999999e-05 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027697+0000", 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3358000000000001e-05 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9441 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 913408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992127+0000", 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2602189579999994, 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035783518, 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9441 2024-09-14T07:12:12.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992127+0000", 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992127+0000", 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992128+0000", 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2599999999999998e-07 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992130+0000", 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8950000000000001e-06 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992136+0000", 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.122e-06 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992141+0000", 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.651e-06 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027731+0000", 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035590899000000002 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027822+0000", 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0241999999999994e-05 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027911+0000", 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9283000000000006e-05 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9442 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 954368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992243+0000", 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2601030160000004, 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035794903000000003, 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9442 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992243+0000", 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992243+0000", 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992244+0000", 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1100000000000004e-07 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992248+0000", 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8659999999999999e-06 2024-09-14T07:12:12.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992260+0000", 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2320999999999999e-05 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992265+0000", 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9339999999999997e-06 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027931+0000", 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035665954 2024-09-14T07:12:12.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.027992+0000", 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0718999999999999e-05 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028038+0000", 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6198000000000001e-05 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9443 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 995328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992281+0000", 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2600656929999996, 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035957507, 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9443 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992281+0000", 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992281+0000", 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992281+0000", 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1799999999999995e-07 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992284+0000", 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992290+0000", 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850000000000002e-06 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992303+0000", 2024-09-14T07:12:12.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3275000000000001e-05 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028082+0000", 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035778313999999999 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028157+0000", 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5490999999999999e-05 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028238+0000", 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1182999999999998e-05 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9444 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1089536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992312+0000", 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2600345990000008, 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036105560000000002, 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9444 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992312+0000", 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992312+0000", 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992312+0000", 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8899999999999999e-07 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992315+0000", 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2639999999999998e-06 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992321+0000", 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4690000000000002e-06 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992329+0000", 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2160000000000006e-06 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028269+0000", 2024-09-14T07:12:12.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035940140000000002 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028342+0000", 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2103999999999999e-05 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028417+0000", 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5778000000000005e-05 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9445 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1130496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992348+0000", 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2599984170000003, 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036244659999999998, 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9445 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992348+0000", 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992348+0000", 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992349+0000", 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4899999999999995e-07 2024-09-14T07:12:12.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992351+0000", 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7989999999999998e-06 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992359+0000", 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2790000000000001e-06 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992363+0000", 2024-09-14T07:12:12.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4299999999999999e-06 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028448+0000", 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036084924999999997 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028520+0000", 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1676999999999998e-05 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028593+0000", 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2900999999999999e-05 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9446 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1224704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992370+0000", 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2599759870000007, 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036404032000000003, 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9446 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992370+0000", 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992370+0000", 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992371+0000", 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1600000000000001e-07 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992373+0000", 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.345e-06 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992379+0000", 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2079999999999997e-06 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992384+0000", 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3209999999999998e-06 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028633+0000", 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036249394999999997 2024-09-14T07:12:12.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028704+0000", 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0414999999999996e-05 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028774+0000", 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0832000000000002e-05 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:9447 3.1e 3:7fcd138d:::rbd_data.1182823d0fd0.0000000000000002:6 [read 1265664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.992440+0000", 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2599062330000006, 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036533058, 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 9447 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:12.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992440+0000", 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992440+0000", 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992441+0000", 2024-09-14T07:12:12.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4600000000000004e-07 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992444+0000", 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9890000000000001e-06 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992456+0000", 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2079000000000001e-05 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.992462+0000", 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8889999999999999e-06 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028807+0000", 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.036345127999999997 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028888+0000", 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1352000000000003e-05 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:12.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:04.028973+0000", 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4975000000000005e-05 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:12.343 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:12.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:12.345 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:12.343+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:12.445 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:12.444+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:12.461 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:12.461 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:12.461 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:12.461 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:12.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:12.545 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:12.545+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:12.614 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:12.616 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:12.616 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:12.616 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:12.616 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:12.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:12.646 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:12.646+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:12.726 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:2164 3.1a 3:59f81f62:::rbd_data.1182823d0fd0.0000000000000031:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.422204503, 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013431442, 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2164 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302750+0000", 2024-09-14T07:12:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302751+0000", 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.003e-06 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302755+0000", 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059999999999996e-06 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302767+0000", 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1204e-05 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302772+0000", 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7270000000000004e-06 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302816+0000", 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3322999999999998e-05 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.302909+0000", 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3614000000000002e-05 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.304973+0000", 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020640609999999998 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316056+0000", 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011082992 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316073+0000", 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6512e-05 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316128+0000", 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.469e-05 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:59.316181+0000", 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3709999999999999e-05 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7896 3.1a 3:5aa1acb5:::rbd_object_map.1182a7d91484:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.780587+0000", 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9443671009999992, 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013959997, 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7896 2024-09-14T07:12:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780587+0000", 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780587+0000", 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780588+0000", 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780590+0000", 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6000000000000001e-06 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780596+0000", 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8100000000000003e-06 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780601+0000", 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5560000000000001e-06 2024-09-14T07:12:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.787899+0000", 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072989329999999996 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.787976+0000", 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6606000000000005e-05 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.788324+0000", 2024-09-14T07:12:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000348148 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.792033+0000", 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037089100000000002 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794457+0000", 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0024239520000000001 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794509+0000", 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.236e-05 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794547+0000", 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7737000000000001e-05 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7897 3.1a 3:5aa1acb5:::rbd_object_map.1182a7d91484:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.780616+0000", 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9443381409999994, 2024-09-14T07:12:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014270984, 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7897 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780616+0000", 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780616+0000", 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780617+0000", 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.08e-07 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780619+0000", 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6869999999999999e-06 2024-09-14T07:12:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780625+0000", 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9549999999999997e-06 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780631+0000", 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9989999999999997e-06 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.788726+0000", 2024-09-14T07:12:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0080944190000000003 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.788776+0000", 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9960000000000003e-05 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.789097+0000", 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032093900000000001 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794604+0000", 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055077349999999997 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794810+0000", 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020557 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794860+0000", 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0039e-05 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794887+0000", 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7273000000000001e-05 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7898 3.1a 3:5aa1acb5:::rbd_object_map.1182a7d91484:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.780641+0000", 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9443135680000001, 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014302844, 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7898 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780641+0000", 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780641+0000", 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780641+0000", 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5600000000000001e-07 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780644+0000", 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780654+0000", 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0064000000000001e-05 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.780659+0000", 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2669999999999997e-06 2024-09-14T07:12:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.789409+0000", 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087498469999999998 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.789488+0000", 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9264000000000005e-05 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.789836+0000", 2024-09-14T07:12:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034799800000000002 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794655+0000", 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048189260000000003 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794900+0000", 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024523900000000001 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794924+0000", 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3838000000000001e-05 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.794944+0000", 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9347e-05 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:9449 3.a e34/23 3:56e24ad3:::rbd_data.1182b13d849f.0000000000000000:head v 34'50, mlcod=34'48)", 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.083447+0000", 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.6415071670000003, 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.02347088, 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083447+0000", 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083447+0000", 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083449+0000", 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7799999999999999e-06 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.087169+0000", 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037197139999999998 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.087190+0000", 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1518999999999998e-05 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.087200+0000", 2024-09-14T07:12:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0141e-05 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.087269+0000", 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8785e-05 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.087296+0000", 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7047999999999999e-05 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106852+0000", 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.019555814000000001 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106918+0000", 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6079000000000002e-05 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13403 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 10485760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960235+0000", 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.764719602, 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012669501999999999, 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13403 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960235+0000", 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960235+0000", 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960235+0000", 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960236+0000", 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7199999999999997e-07 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960239+0000", 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.802e-06 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960241+0000", 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.379e-06 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.972774+0000", 2024-09-14T07:12:12.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012532949 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.972823+0000", 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9203000000000003e-05 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.972904+0000", 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1087000000000005e-05 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13404 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 10944512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960244+0000", 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7647106030000002, 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012800880000000001, 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13404 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.761 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960244+0000", 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960244+0000", 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960244+0000", 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:12.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960248+0000", 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960251+0000", 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960253+0000", 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4420000000000001e-06 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.972928+0000", 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012674797 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.972974+0000", 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5881999999999999e-05 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973045+0000", 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0638999999999999e-05 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13405 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 11403264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960257+0000", 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.764697564, 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012926237, 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.765 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13405 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960257+0000", 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960257+0000", 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960257+0000", 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960261+0000", 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7910000000000002e-06 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960264+0000", 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2009999999999999e-06 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960266+0000", 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2809999999999998e-06 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973067+0000", 2024-09-14T07:12:12.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012800326000000001 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973113+0000", 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6910999999999999e-05 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973183+0000", 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9496e-05 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13406 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 11862016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960270+0000", 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7646845419999999, 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013048976, 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13406 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.770 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960270+0000", 2024-09-14T07:12:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960270+0000", 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960270+0000", 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960271+0000", 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1100000000000004e-07 2024-09-14T07:12:12.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960274+0000", 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9569999999999998e-06 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960276+0000", 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.34e-06 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973205+0000", 2024-09-14T07:12:12.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01292899 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973248+0000", 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2576e-05 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973319+0000", 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0981000000000004e-05 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13407 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 12320768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960279+0000", 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7646753249999998, 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013182783999999999, 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.775 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13407 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960279+0000", 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960279+0000", 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960279+0000", 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.03e-07 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960280+0000", 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9800000000000002e-07 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960283+0000", 2024-09-14T07:12:12.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7539999999999998e-06 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960285+0000", 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3259999999999998e-06 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973341+0000", 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013055844 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973390+0000", 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9082000000000002e-05 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973462+0000", 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1676999999999998e-05 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.779 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13408 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 12779520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960288+0000", 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.764666413, 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013310628999999999, 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13408 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960288+0000", 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960288+0000", 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960288+0000", 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:12.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960293+0000", 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.383e-06 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960297+0000", 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0469999999999998e-06 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960299+0000", 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3640000000000002e-06 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973484+0000", 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013184678 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973528+0000", 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4308000000000003e-05 2024-09-14T07:12:12.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973598+0000", 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0642000000000006e-05 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13409 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 13238272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960302+0000", 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7646523350000001, 2024-09-14T07:12:12.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013437877000000001, 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13409 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960302+0000", 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960302+0000", 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960302+0000", 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960303+0000", 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:12:12.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960306+0000", 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8789999999999999e-06 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960308+0000", 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3520000000000001e-06 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973620+0000", 2024-09-14T07:12:12.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013312150999999999 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973669+0000", 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8403999999999999e-05 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973740+0000", 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1030000000000003e-05 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13410 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 13697024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960311+0000", 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7646432499999998, 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013563393, 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13410 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960311+0000", 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960311+0000", 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960311+0000", 2024-09-14T07:12:12.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960312+0000", 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0699999999999996e-07 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960315+0000", 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.858e-06 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960320+0000", 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3839999999999996e-06 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973762+0000", 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013441375 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973806+0000", 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3977999999999998e-05 2024-09-14T07:12:12.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973874+0000", 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8682000000000004e-05 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13411 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 14155776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960353+0000", 2024-09-14T07:12:12.793 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7646015209999999, 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013667172, 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13411 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960353+0000", 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960353+0000", 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960353+0000", 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960354+0000", 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3599999999999999e-06 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960358+0000", 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8770000000000003e-06 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960361+0000", 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973900+0000", 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013538826 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.973949+0000", 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8579999999999999e-05 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974020+0000", 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1328999999999994e-05 2024-09-14T07:12:12.797 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13412 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 14614528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960366+0000", 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7645879259999999, 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013790199, 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.798 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13412 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960366+0000", 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960366+0000", 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960367+0000", 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1199999999999999e-07 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960368+0000", 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960373+0000", 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2340000000000002e-06 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960378+0000", 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5839999999999996e-06 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974043+0000", 2024-09-14T07:12:12.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013664506 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974088+0000", 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.528e-05 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974157+0000", 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8759999999999999e-05 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.802 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13413 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 15073280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960385+0000", 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.764569512, 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013907917000000001, 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.803 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13413 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960385+0000", 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960385+0000", 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960385+0000", 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960387+0000", 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8330000000000001e-06 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960394+0000", 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.272e-06 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960399+0000", 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6949999999999999e-06 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974178+0000", 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013778881999999999 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974223+0000", 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5563999999999999e-05 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974293+0000", 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9295000000000007e-05 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.807 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13414 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 15532032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960405+0000", 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7645491780000002, 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014025612999999999, 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13414 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960405+0000", 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960405+0000", 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960405+0000", 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4999999999999998e-07 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960407+0000", 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.745e-06 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960414+0000", 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4479999999999999e-06 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960418+0000", 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7430000000000002e-06 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974315+0000", 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013896664 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974360+0000", 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4904999999999998e-05 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974431+0000", 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0758000000000003e-05 2024-09-14T07:12:12.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13415 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960425+0000", 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7645297549999999, 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014145793, 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13415 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960425+0000", 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960425+0000", 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960425+0000", 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8099999999999998e-07 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960427+0000", 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6920000000000001e-06 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960433+0000", 2024-09-14T07:12:12.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2369999999999997e-06 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960438+0000", 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7199999999999997e-06 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974453+0000", 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014015451 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974501+0000", 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7602999999999998e-05 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974570+0000", 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9709000000000006e-05 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.816 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:13416 3.1c 3:39ca17c1:::rbd_data.1182c19f8219.0000000000000000:b [sparse-read 16449536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.960444+0000", 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.764510633, 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014253428, 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:12.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 13416 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960444+0000", 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960444+0000", 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960444+0000", 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960455+0000", 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1071e-05 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960462+0000", 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8530000000000003e-06 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.960471+0000", 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9099999999999994e-06 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974585+0000", 2024-09-14T07:12:12.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014114316999999999 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974629+0000", 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3591999999999999e-05 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.974697+0000", 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8280000000000004e-05 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:13457 3.1 e39/23 3:87da2724:::rbd_data.1182dfea3896.0000000000000006:head v 39'57, mlcod=34'54)", 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:08.984614+0000", 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7403401389999997, 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034719188999999998, 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.984614+0000", 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.984614+0000", 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.984616+0000", 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5600000000000001e-06 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.995994+0000", 2024-09-14T07:12:12.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01137839 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.996010+0000", 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6055000000000001e-05 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.996017+0000", 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2710000000000003e-06 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.996084+0000", 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6817999999999996e-05 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:08.996108+0000", 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3898999999999999e-05 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:09.019277+0000", 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023168958 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:12.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:09.019333+0000", 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6237999999999999e-05 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:12.826 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:12.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:12.828 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:12.827+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:12.891 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-14T07:12:12.928 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:12.927+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:12.929 INFO:teuthology.orchestra.run.smithi071.stdout:1423 write 0x31abd4b thru 0x31b06c3 (0x4979 bytes) 2024-09-14T07:12:12.933 INFO:teuthology.orchestra.run.smithi071.stdout:1424 punch from 0x1ce2643 to 0x1ceaa71, (0x842e bytes) 2024-09-14T07:12:12.933 INFO:teuthology.orchestra.run.smithi071.stdout:1425 read 0x241bafe thru 0x24230f4 (0x75f7 bytes) 2024-09-14T07:12:12.933 INFO:teuthology.orchestra.run.smithi071.stdout:1426 punch from 0x4722eb to 0x4782c8, (0x5fdd bytes) 2024-09-14T07:12:12.933 INFO:teuthology.orchestra.run.smithi071.stdout:1427 punch from 0x2097cf1 to 0x20a6121, (0xe430 bytes) 2024-09-14T07:12:12.933 INFO:teuthology.orchestra.run.smithi071.stdout:1428 read 0x456bfc thru 0x45ca79 (0x5e7e bytes) 2024-09-14T07:12:12.933 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:12.934 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:12.934 INFO:teuthology.orchestra.run.smithi071.stdout:1431 writesame 0x3054588 thru 0x305a672 data_size 0x1(0x60eb bytes) 2024-09-14T07:12:12.947 INFO:teuthology.orchestra.run.smithi071.stdout:1432 punch from 0x29cec4f to 0x29d9ed6, (0xb287 bytes) 2024-09-14T07:12:12.964 INFO:teuthology.orchestra.run.smithi071.stdout:1433 write 0xd78c286 thru 0xd78d4e0 (0x125b bytes) 2024-09-14T07:12:12.967 INFO:teuthology.orchestra.run.smithi071.stdout:1434 read 0x2b12276 thru 0x2b1a434 (0x81bf bytes) 2024-09-14T07:12:12.967 INFO:teuthology.orchestra.run.smithi071.stdout:1437 write 0xf128bc thru 0xf19ce4 (0x7429 bytes) 2024-09-14T07:12:12.973 INFO:teuthology.orchestra.run.smithi071.stdout:1438 write 0xbc60d24 thru 0xbc694d7 (0x87b4 bytes) 2024-09-14T07:12:12.975 INFO:teuthology.orchestra.run.smithi071.stdout:1440 write 0x473a479 thru 0x474829f (0xde27 bytes) 2024-09-14T07:12:12.979 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:12.979 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:12.979 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:12.981 INFO:teuthology.orchestra.run.smithi071.stdout:1441 read 0x9c02ab8 thru 0x9c0f6e6 (0xcc2f bytes) 2024-09-14T07:12:12.981 INFO:teuthology.orchestra.run.smithi071.stdout:1442 write 0xcfff974 thru 0xd00c6c6 (0xcd53 bytes) 2024-09-14T07:12:12.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:12.993 INFO:teuthology.orchestra.run.smithi071.stdout:1443 trunc from 0xd78d4e1 to 0x60ce58f 2024-09-14T07:12:13.002 INFO:teuthology.orchestra.run.smithi071.stdout:1444 punch from 0x494387a to 0x495268c, (0xee12 bytes) 2024-09-14T07:12:13.004 INFO:teuthology.orchestra.run.smithi071.stdout:1445 trunc from 0x60ce58f to 0x7373f38 2024-09-14T07:12:13.015 INFO:teuthology.orchestra.run.smithi071.stdout:1448 trunc from 0x7373f38 to 0xc59e13d 2024-09-14T07:12:13.020 INFO:teuthology.orchestra.run.smithi071.stdout:1449 read 0x6dfdbe6 thru 0x6e0a20f (0xc62a bytes) 2024-09-14T07:12:13.020 INFO:teuthology.orchestra.run.smithi071.stdout:1451 punch from 0x65f5038 to 0x65f9106, (0x40ce bytes) 2024-09-14T07:12:13.025 INFO:teuthology.orchestra.run.smithi071.stdout:1455 write 0xcd8dad7 thru 0xcd98025 (0xa54f bytes) 2024-09-14T07:12:13.029 INFO:teuthology.orchestra.run.smithi071.stdout:1456 trunc from 0xcd98026 to 0xbc7fc1d 2024-09-14T07:12:13.029 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:13.028+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:13.037 INFO:teuthology.orchestra.run.smithi071.stdout:1457 write 0x3a20d63 thru 0x3a228b0 (0x1b4e bytes) 2024-09-14T07:12:13.039 INFO:teuthology.orchestra.run.smithi071.stdout:1458 punch from 0xba1ff78 to 0xba2fda8, (0xfe30 bytes) 2024-09-14T07:12:13.039 INFO:teuthology.orchestra.run.smithi071.stdout:1461 write 0x377c24f thru 0x377dd3d (0x1aef bytes) 2024-09-14T07:12:13.044 INFO:teuthology.orchestra.run.smithi071.stdout:1463 punch from 0x913adc6 to 0x913e5ff, (0x3839 bytes) 2024-09-14T07:12:13.044 INFO:teuthology.orchestra.run.smithi071.stdout:1464 punch from 0x3c58c3f to 0x3c5aeb0, (0x2271 bytes) 2024-09-14T07:12:13.044 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:13.044 INFO:teuthology.orchestra.run.smithi071.stdout:1467 write 0x657edc thru 0x662053 (0xa178 bytes) 2024-09-14T07:12:13.057 INFO:teuthology.orchestra.run.smithi071.stdout:1468 write 0xc917c38 thru 0xc92088c (0x8c55 bytes) 2024-09-14T07:12:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:1470 read 0x5ef1034 thru 0x5f00641 (0xf60e bytes) 2024-09-14T07:12:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:1472 read 0x31dfdaf thru 0x31ed027 (0xd279 bytes) 2024-09-14T07:12:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:1474 punch from 0x17c24ce to 0x17ce740, (0xc272 bytes) 2024-09-14T07:12:13.060 INFO:teuthology.orchestra.run.smithi071.stdout:1475 write 0x4950e40 thru 0x4953f49 (0x310a bytes) 2024-09-14T07:12:13.061 INFO:teuthology.orchestra.run.smithi071.stdout:1476 read 0x10c729e thru 0x10c84f4 (0x1257 bytes) 2024-09-14T07:12:13.061 INFO:teuthology.orchestra.run.smithi071.stdout:1477 read 0x920dd34 thru 0x9219c64 (0xbf31 bytes) 2024-09-14T07:12:13.061 INFO:teuthology.orchestra.run.smithi071.stdout:1478 read 0x5c5448c thru 0x5c60133 (0xbca8 bytes) 2024-09-14T07:12:13.061 INFO:teuthology.orchestra.run.smithi071.stdout:1479 write 0x60f8d2e thru 0x60fd706 (0x49d9 bytes) 2024-09-14T07:12:13.064 INFO:teuthology.orchestra.run.smithi071.stdout:1480 read 0x61bd782 thru 0x61c1ba9 (0x4428 bytes) 2024-09-14T07:12:13.070 INFO:teuthology.orchestra.run.smithi071.stdout:1481 trunc from 0xc92088d to 0x6ad5ae9 2024-09-14T07:12:13.081 INFO:teuthology.orchestra.run.smithi071.stdout:1482 clone 13 order 18 su 4096 sc 14 2024-09-14T07:12:13.096 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:13.096 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:13.096 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:13.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:13.151 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:13.149+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9449 3.a 3:56e24ad3:::rbd_data.1182b13d849f.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18850559~65145] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:13.209 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.138747876, 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039129075999999999, 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9449 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068072+0000", 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1220000000000002e-06 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082261+0000", 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014189286000000001 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082289+0000", 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8123000000000002e-05 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082307+0000", 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7864e-05 2024-09-14T07:12:13.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082406+0000", 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9223999999999997e-05 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082564+0000", 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015800499999999999 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083260+0000", 2024-09-14T07:12:13.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069602200000000003 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106367+0000", 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023106318000000001 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107084+0000", 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000717036 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:13.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107149+0000", 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5581999999999997e-05 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107199+0000", 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9493999999999997e-05 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9652 3.a 3:54c0685c:::rbd_data.1182b13d849f.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:13.215 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.8443655339999996, 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021904389, 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9652 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362454+0000", 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6050000000000001e-06 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362461+0000", 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5769999999999996e-06 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362477+0000", 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5468000000000002e-05 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362484+0000", 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8650000000000003e-06 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362541+0000", 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7172000000000001e-05 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362617+0000", 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6720999999999999e-05 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.366104+0000", 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003486627 2024-09-14T07:12:13.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384214+0000", 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018109912999999998 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384267+0000", 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3557000000000002e-05 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384303+0000", 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5340999999999999e-05 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384356+0000", 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3542999999999999e-05 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9655 3.a 3:509dad81:::rbd_data.1182b13d849f.0000000000000003:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.8173598420000001, 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021682784, 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9655 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389459+0000", 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2024-09-14T07:12:13.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389463+0000", 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.578e-06 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389473+0000", 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8409999999999995e-06 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389481+0000", 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0970000000000006e-06 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389525+0000", 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4202999999999997e-05 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389568+0000", 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3256000000000001e-05 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.392432+0000", 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028639249999999998 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411020+0000", 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018587139999999999 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411037+0000", 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7706e-05 2024-09-14T07:12:13.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411090+0000", 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3100999999999999e-05 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411140+0000", 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0105999999999998e-05 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17046 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.576343437, 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014488113, 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17046 2024-09-14T07:12:13.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630476+0000", 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.544e-06 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630482+0000", 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6380000000000001e-06 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630491+0000", 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9600000000000006e-06 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644872+0000", 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014381817999999999 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644913+0000", 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1060000000000003e-05 2024-09-14T07:12:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644962+0000", 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8763000000000001e-05 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17048 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5763208629999999, 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014574066, 2024-09-14T07:12:13.232 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17048 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630499+0000", 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7850000000000001e-06 2024-09-14T07:12:13.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630506+0000", 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9290000000000001e-06 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630510+0000", 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639999999999998e-06 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644985+0000", 2024-09-14T07:12:13.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014474579 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645022+0000", 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6976e-05 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645071+0000", 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8838000000000002e-05 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17049 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5763016159999999, 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014662021000000001, 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17049 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.237 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630518+0000", 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6470000000000001e-06 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630524+0000", 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7189999999999998e-06 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630528+0000", 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3150000000000002e-06 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645093+0000", 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014565339 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645128+0000", 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5085e-05 2024-09-14T07:12:13.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645178+0000", 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9546000000000003e-05 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17050 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5762838239999999, 2024-09-14T07:12:13.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014750216, 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17050 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:13.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630536+0000", 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630542+0000", 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2779999999999999e-06 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630547+0000", 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.904e-06 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645201+0000", 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014653895 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645235+0000", 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4319000000000001e-05 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645284+0000", 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8730999999999998e-05 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17054 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.576262834, 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014837476, 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17054 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630561+0000", 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3980000000000004e-06 2024-09-14T07:12:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630569+0000", 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1570000000000003e-06 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630573+0000", 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7650000000000001e-06 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645309+0000", 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014735355 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645345+0000", 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6019999999999997e-05 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645392+0000", 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7401999999999998e-05 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17055 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1507328~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.576237678, 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014923962000000001, 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17055 2024-09-14T07:12:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.08e-07 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630582+0000", 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6950000000000001e-06 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630588+0000", 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7039999999999999e-06 2024-09-14T07:12:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630592+0000", 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3329999999999998e-06 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645416+0000", 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014824324999999999 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645457+0000", 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0813999999999999e-05 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645504+0000", 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6683e-05 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17056 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:13.255 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5762198170000001, 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015015735000000001, 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17056 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630600+0000", 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.654e-06 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630605+0000", 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630609+0000", 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.827e-06 2024-09-14T07:12:13.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645528+0000", 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014918849 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645566+0000", 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8586e-05 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645613+0000", 2024-09-14T07:12:13.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7034999999999999e-05 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17057 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630639+0000", 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5761781080000001, 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015086544, 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.260 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17057 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630639+0000", 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630639+0000", 2024-09-14T07:12:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630640+0000", 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7100000000000002e-07 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630643+0000", 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1159999999999999e-06 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630650+0000", 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630655+0000", 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3290000000000001e-06 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645637+0000", 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014982235 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645676+0000", 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8951e-05 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645726+0000", 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9691999999999998e-05 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17062 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1507328~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.264 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5761535470000001, 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015167762, 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17062 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630666+0000", 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8339999999999999e-06 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630675+0000", 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1609999999999992e-06 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630680+0000", 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5809999999999998e-06 2024-09-14T07:12:13.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645748+0000", 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015068359 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645783+0000", 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5160000000000002e-05 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645832+0000", 2024-09-14T07:12:13.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8282000000000003e-05 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17065 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.57613077, 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015260516999999999, 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17065 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:13.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1300000000000001e-07 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630695+0000", 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0860000000000002e-06 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630701+0000", 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0610000000000001e-06 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630710+0000", 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8230000000000001e-06 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645856+0000", 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015145844 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645896+0000", 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9934000000000001e-05 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645947+0000", 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1356000000000001e-05 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17067 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5760976840000001, 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015340179000000001, 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17067 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.274 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:13.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630727+0000", 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630733+0000", 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.584e-06 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630738+0000", 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.904e-06 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645971+0000", 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015233459 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646008+0000", 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6999000000000003e-05 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646060+0000", 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1536000000000003e-05 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17068 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5760728230000001, 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015424548999999999, 2024-09-14T07:12:13.278 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17068 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.41e-07 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630747+0000", 2024-09-14T07:12:13.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6819999999999999e-06 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630752+0000", 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3380000000000004e-06 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630756+0000", 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3429999999999998e-06 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646085+0000", 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015328422 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646122+0000", 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6993000000000003e-05 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646169+0000", 2024-09-14T07:12:13.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7429999999999998e-05 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17071 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630762+0000", 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5760551980000002, 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015514421, 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.283 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17071 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630762+0000", 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630762+0000", 2024-09-14T07:12:13.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630763+0000", 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630764+0000", 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7230000000000001e-06 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630770+0000", 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4639999999999997e-06 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630774+0000", 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5569999999999997e-06 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646194+0000", 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015419696 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646232+0000", 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7632999999999997e-05 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646277+0000", 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4978000000000002e-05 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17072 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.287 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.576037793, 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015607464999999999, 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17072 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4200000000000002e-07 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630782+0000", 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.671e-06 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630787+0000", 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5759999999999996e-06 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630792+0000", 2024-09-14T07:12:13.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.335e-06 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646303+0000", 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015511087999999999 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646339+0000", 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6390000000000002e-05 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646387+0000", 2024-09-14T07:12:13.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8062999999999997e-05 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17075 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5760203989999999, 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015703917000000001, 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.292 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17075 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630799+0000", 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7680000000000001e-06 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630804+0000", 2024-09-14T07:12:13.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0019999999999997e-06 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630814+0000", 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6239999999999997e-06 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646412+0000", 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015598216 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646451+0000", 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8979000000000001e-05 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646501+0000", 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9962e-05 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17076 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.296 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5759854789999999, 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015780890999999998, 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17076 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5299999999999999e-07 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630835+0000", 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.193e-06 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630841+0000", 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0680000000000002e-06 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630846+0000", 2024-09-14T07:12:13.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9010000000000002e-06 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646526+0000", 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015680619999999999 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646563+0000", 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6359000000000002e-05 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646613+0000", 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0297000000000003e-05 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17077 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5759617459999999, 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015857907000000001, 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:13.301 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17077 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:13.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2399999999999999e-07 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630858+0000", 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9709999999999998e-06 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630864+0000", 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4569999999999996e-06 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630868+0000", 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6840000000000004e-06 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646629+0000", 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015760884999999999 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646664+0000", 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4341000000000002e-05 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646714+0000", 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0145000000000002e-05 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:13.305 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:13.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:13.307 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:13.306+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:13.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:13.407 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:13.406+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:13.450 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:13.450 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:13.450 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:13.450 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:13.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:13.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:13.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:13.508 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:13.507+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:13.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:13.511 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:13.511 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:13.511 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T07:12:13.511 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.000000 2024-09-14T07:12:13.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0 2024-09-14T07:12:13.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:13.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:13.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:13.544 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:13.544 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:13.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:13.561 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:13.563 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:13.563 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:13.563 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:13.563 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:13.563 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:13.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:13.577 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:13.578 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:13.581 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:13.581 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:13.616 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:13.615+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:13.675 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:13.675 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:13.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:13.727 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:13.726+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:13.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:12:13.795 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:13.795 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:13.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:13.811 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:13.810+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:13.819 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone12 from 0x6ad5ae9 (overlap 0x1b69abf) to 0x8394d2 2024-09-14T07:12:13.900 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-14T07:12:13.912 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:13.911+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:13.938 INFO:teuthology.orchestra.run.smithi071.stdout:1483 punch from 0x1ec5f06 to 0x1ed4cc7, (0xedc1 bytes) 2024-09-14T07:12:13.941 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:13.941 INFO:teuthology.orchestra.run.smithi071.stdout:1485 writesame 0x648d5df thru 0x649319a data_size 0x39(0x5bbc bytes) 2024-09-14T07:12:13.945 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:13.945 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:13.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:13.966 INFO:teuthology.orchestra.run.smithi071.stdout:1486 write 0x9ce71fd thru 0x9ceb793 (0x4597 bytes) 2024-09-14T07:12:13.973 INFO:teuthology.orchestra.run.smithi071.stdout:1488 clone 14 order 21 su 524288 sc 4 2024-09-14T07:12:14.012 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:14.011+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:14.071 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.071 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:14.121 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:14.120+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:14.214 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:14.213+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:14.223 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.223 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:14.316 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:14.315+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:14.375 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.375 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:14.416 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:14.415+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:14.516 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:14.515+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:14.525 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.525 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:14.618 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:14.617+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:14.677 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.677 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:14.727 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:14.726+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:14.757 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.7 primary-affinity to 0 (802) 2024-09-14T07:12:14.763 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:12:14.819 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:14.818+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:14.828 INFO:teuthology.orchestra.run.smithi071.stdout:leaving image image_client.0-clone13 intact 2024-09-14T07:12:14.845 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.845 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:14.920 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:14.920+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:14.958 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-14T07:12:14.968 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:14.968 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:14.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:15.021 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:15.021+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:15.080 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:15.080 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:15.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:15.122 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:15.122+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:15.191 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:15.191 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:15.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:15.223 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:15.223+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:15.302 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:15.302 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:15.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:15.355 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:15.354+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:15.419 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:15.419 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:15.425 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:15.425+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:15.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:15.527 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:15.526+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:15.570 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:15.571 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:15.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:15.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:15.628 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:15.627+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:15.683 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:15.683 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:15.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:15.703 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:15.704 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:15.720 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:15.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:15.729 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:15.728+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:15.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:15.736 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:15.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:15.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:15.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:15.778 INFO:teuthology.orchestra.run.smithi071.stdout:1489 punch from 0x4c0210 to 0x4c49fc, (0x47ec bytes) 2024-09-14T07:12:15.787 INFO:teuthology.orchestra.run.smithi071.stdout:1490 write 0xa1bd841 thru 0xa1c0a27 (0x31e7 bytes) 2024-09-14T07:12:15.789 INFO:teuthology.orchestra.run.smithi071.stdout:1491 read 0x1d288e6 thru 0x1d3012e (0x7849 bytes) 2024-09-14T07:12:15.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:15.799 INFO:teuthology.orchestra.run.smithi071.stdout:1492 write 0xdff853c thru 0xdffc905 (0x43ca bytes) 2024-09-14T07:12:15.801 INFO:teuthology.orchestra.run.smithi071.stdout:1493 read 0x6d41677 thru 0x6d4a9ff (0x9389 bytes) 2024-09-14T07:12:15.802 INFO:teuthology.orchestra.run.smithi071.stdout:1494 write 0xb27b7a0 thru 0xb289180 (0xd9e1 bytes) 2024-09-14T07:12:15.805 INFO:teuthology.orchestra.run.smithi071.stdout:1495 writesame 0x2d1292b thru 0x2d1f87a data_size 0x7c(0xcf50 bytes) 2024-09-14T07:12:15.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:15.811 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:15.811 INFO:teuthology.orchestra.run.smithi071.stdout:1498 punch from 0x7cb485e to 0x7cc43cb, (0xfb6d bytes) 2024-09-14T07:12:15.812 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:15.812 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:15.813 INFO:teuthology.orchestra.run.smithi071.stdout:1499 trunc from 0xdffc906 to 0xce1aba1 2024-09-14T07:12:15.820 INFO:teuthology.orchestra.run.smithi071.stdout:1500 write 0x99b6759 thru 0x99c1364 (0xac0c bytes) 2024-09-14T07:12:15.824 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:15.824 INFO:teuthology.orchestra.run.smithi071.stdout:1504 read 0xa4c1b52 thru 0xa4d11ca (0xf679 bytes) 2024-09-14T07:12:15.824 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:15.824 INFO:teuthology.orchestra.run.smithi071.stdout:1506 read 0x3ade253 thru 0x3aec34a (0xe0f8 bytes) 2024-09-14T07:12:15.824 INFO:teuthology.orchestra.run.smithi071.stdout:1508 writesame 0x9d15067 thru 0x9d17372 data_size 0x2(0x230c bytes) 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:1509 read 0x3b71fec thru 0x3b736de (0x16f3 bytes) 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:1510 read 0x94f5a9e thru 0x94fda12 (0x7f75 bytes) 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:1513 read 0x4ce431b thru 0x4cf258e (0xe274 bytes) 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:1514 read 0x6c0a4e7 thru 0x6c0d1be (0x2cd8 bytes) 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:1515 read 0x58bff74 thru 0x58c1eae (0x1f3b bytes) 2024-09-14T07:12:15.830 INFO:teuthology.orchestra.run.smithi071.stdout:1517 write 0x3bcdd18 thru 0x3bd4a94 (0x6d7d bytes) 2024-09-14T07:12:15.830 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:15.829+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:15.850 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:15.850 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:15.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:15.931 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:15.930+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:16.002 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:16.002 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:16.002 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:16.002 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:16.002 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:16.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:16.053 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:16.053+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:16.074 INFO:teuthology.orchestra.run.smithi071.stdout:1518 write 0x1b64e55 thru 0x1b73586 (0xe732 bytes) 2024-09-14T07:12:16.122 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9449 3.a 3:56e24ad3:::rbd_data.1182b13d849f.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18850559~65145] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.053179176, 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039129075999999999, 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9449 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068072+0000", 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1220000000000002e-06 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082261+0000", 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014189286000000001 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082289+0000", 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8123000000000002e-05 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082307+0000", 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7864e-05 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082406+0000", 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9223999999999997e-05 2024-09-14T07:12:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082564+0000", 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015800499999999999 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083260+0000", 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069602200000000003 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106367+0000", 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023106318000000001 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107084+0000", 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000717036 2024-09-14T07:12:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107149+0000", 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5581999999999997e-05 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107199+0000", 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9493999999999997e-05 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9652 3.a 3:54c0685c:::rbd_data.1182b13d849f.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.758796834, 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021904389, 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9652 2024-09-14T07:12:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362452+0000", 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362454+0000", 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6050000000000001e-06 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362461+0000", 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5769999999999996e-06 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362477+0000", 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5468000000000002e-05 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362484+0000", 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8650000000000003e-06 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362541+0000", 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7172000000000001e-05 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.362617+0000", 2024-09-14T07:12:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6720999999999999e-05 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.366104+0000", 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003486627 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384214+0000", 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018109912999999998 2024-09-14T07:12:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384267+0000", 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3557000000000002e-05 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384303+0000", 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5340999999999999e-05 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.384356+0000", 2024-09-14T07:12:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3542999999999999e-05 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9655 3.a 3:509dad81:::rbd_data.1182b13d849f.0000000000000003:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 11.731791142000001, 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.021682784, 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9655 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389458+0000", 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389459+0000", 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389463+0000", 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.578e-06 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389473+0000", 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8409999999999995e-06 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389481+0000", 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0970000000000006e-06 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389525+0000", 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4202999999999997e-05 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.389568+0000", 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3256000000000001e-05 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.392432+0000", 2024-09-14T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028639249999999998 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411020+0000", 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.018587139999999999 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411037+0000", 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7706e-05 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411090+0000", 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3100999999999999e-05 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.411140+0000", 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0105999999999998e-05 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17046 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4907747369999997, 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014488113, 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17046 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630474+0000", 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630476+0000", 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.544e-06 2024-09-14T07:12:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630482+0000", 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6380000000000001e-06 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630491+0000", 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9600000000000006e-06 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644872+0000", 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014381817999999999 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644913+0000", 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1060000000000003e-05 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644962+0000", 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8763000000000001e-05 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17048 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4907521629999998, 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014574066, 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17048 2024-09-14T07:12:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630497+0000", 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630499+0000", 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7850000000000001e-06 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630506+0000", 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9290000000000001e-06 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630510+0000", 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639999999999998e-06 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.644985+0000", 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014474579 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645022+0000", 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6976e-05 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645071+0000", 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8838000000000002e-05 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17049 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4907329159999998, 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014662021000000001, 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17049 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630516+0000", 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630518+0000", 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6470000000000001e-06 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630524+0000", 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7189999999999998e-06 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630528+0000", 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3150000000000002e-06 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645093+0000", 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014565339 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645128+0000", 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5085e-05 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645178+0000", 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9546000000000003e-05 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17050 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4907151240000003, 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014750216, 2024-09-14T07:12:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17050 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630534+0000", 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630536+0000", 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630542+0000", 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2779999999999999e-06 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630547+0000", 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.904e-06 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645201+0000", 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014653895 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645235+0000", 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4319000000000001e-05 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645284+0000", 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8730999999999998e-05 2024-09-14T07:12:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17054 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4906941339999999, 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014837476, 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17054 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630555+0000", 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630561+0000", 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3980000000000004e-06 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630569+0000", 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1570000000000003e-06 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630573+0000", 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7650000000000001e-06 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645309+0000", 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014735355 2024-09-14T07:12:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645345+0000", 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6019999999999997e-05 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645392+0000", 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7401999999999998e-05 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17055 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1507328~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4906689780000004, 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014923962000000001, 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17055 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630580+0000", 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.08e-07 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630582+0000", 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6950000000000001e-06 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630588+0000", 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7039999999999999e-06 2024-09-14T07:12:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630592+0000", 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3329999999999998e-06 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645416+0000", 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014824324999999999 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645457+0000", 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0813999999999999e-05 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645504+0000", 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6683e-05 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17056 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4906511169999996, 2024-09-14T07:12:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015015735000000001, 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17056 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630598+0000", 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630600+0000", 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.654e-06 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630605+0000", 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630609+0000", 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.827e-06 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645528+0000", 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014918849 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645566+0000", 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8586e-05 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645613+0000", 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7034999999999999e-05 2024-09-14T07:12:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17057 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630639+0000", 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4906094080000001, 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015086544, 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17057 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630639+0000", 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630639+0000", 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630640+0000", 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7100000000000002e-07 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630643+0000", 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1159999999999999e-06 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630650+0000", 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630655+0000", 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3290000000000001e-06 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645637+0000", 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014982235 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645676+0000", 2024-09-14T07:12:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8951e-05 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645726+0000", 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9691999999999998e-05 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17062 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1507328~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.490584847, 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015167762, 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17062 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630664+0000", 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630666+0000", 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8339999999999999e-06 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630675+0000", 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1609999999999992e-06 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630680+0000", 2024-09-14T07:12:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5809999999999998e-06 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645748+0000", 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015068359 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645783+0000", 2024-09-14T07:12:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5160000000000002e-05 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645832+0000", 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8282000000000003e-05 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17065 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4905620700000002, 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015260516999999999, 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17065 2024-09-14T07:12:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630687+0000", 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1300000000000001e-07 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630695+0000", 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0860000000000002e-06 2024-09-14T07:12:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630701+0000", 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0610000000000001e-06 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630710+0000", 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8230000000000001e-06 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645856+0000", 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015145844 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645896+0000", 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9934000000000001e-05 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645947+0000", 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1356000000000001e-05 2024-09-14T07:12:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17067 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.490528984, 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015340179000000001, 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17067 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630720+0000", 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630727+0000", 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2999999999999998e-06 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630733+0000", 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.584e-06 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630738+0000", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.904e-06 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.645971+0000", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015233459 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646008+0000", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6999000000000003e-05 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646060+0000", 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1536000000000003e-05 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17068 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.490504123, 2024-09-14T07:12:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015424548999999999, 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17068 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630745+0000", 2024-09-14T07:12:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.41e-07 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630747+0000", 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6819999999999999e-06 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630752+0000", 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3380000000000004e-06 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630756+0000", 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3429999999999998e-06 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646085+0000", 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015328422 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646122+0000", 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6993000000000003e-05 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646169+0000", 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7429999999999998e-05 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17071 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630762+0000", 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4904864980000001, 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015514421, 2024-09-14T07:12:16.201 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17071 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630762+0000", 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630762+0000", 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630763+0000", 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630764+0000", 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7230000000000001e-06 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630770+0000", 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4639999999999997e-06 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630774+0000", 2024-09-14T07:12:16.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5569999999999997e-06 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646194+0000", 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015419696 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646232+0000", 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7632999999999997e-05 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646277+0000", 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4978000000000002e-05 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17072 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4904690929999997, 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015607464999999999, 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17072 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630780+0000", 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4200000000000002e-07 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630782+0000", 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.671e-06 2024-09-14T07:12:16.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630787+0000", 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5759999999999996e-06 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630792+0000", 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.335e-06 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646303+0000", 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015511087999999999 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646339+0000", 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6390000000000002e-05 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646387+0000", 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8062999999999997e-05 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17075 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4904516990000003, 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015703917000000001, 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17075 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630797+0000", 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630799+0000", 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7680000000000001e-06 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630804+0000", 2024-09-14T07:12:16.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0019999999999997e-06 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630814+0000", 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6239999999999997e-06 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646412+0000", 2024-09-14T07:12:16.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015598216 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646451+0000", 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8979000000000001e-05 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646501+0000", 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9962e-05 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17076 3.a 3:538b7563:::rbd_data.1182dfea3896.0000000000000005:c [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4904167790000002, 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015780890999999998, 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17076 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630832+0000", 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5299999999999999e-07 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630835+0000", 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.193e-06 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630841+0000", 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0680000000000002e-06 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630846+0000", 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9010000000000002e-06 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646526+0000", 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015680619999999999 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646563+0000", 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6359000000000002e-05 2024-09-14T07:12:16.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646613+0000", 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0297000000000003e-05 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:17077 3.a 3:57f91d86:::rbd_data.1182dfea3896.0000000000000004:c [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:16.220 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4903930460000003, 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015857907000000001, 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 17077 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630856+0000", 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2399999999999999e-07 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630858+0000", 2024-09-14T07:12:16.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9709999999999998e-06 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630864+0000", 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4569999999999996e-06 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.630868+0000", 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6840000000000004e-06 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646629+0000", 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015760884999999999 2024-09-14T07:12:16.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646664+0000", 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4341000000000002e-05 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:11.646714+0000", 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0145000000000002e-05 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.225 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:16.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1520 read 0x172b69c thru 0x1732d6f (0x76d4 bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1521 read 0xbc83d38 thru 0xbc8b80e (0x7ad7 bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1523 punch from 0x593c135 to 0x59492ad, (0xd178 bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1526 read 0xc7c6941 thru 0xc7ce2f7 (0x79b7 bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1528 read 0xbe7e17b thru 0xbe818c8 (0x374e bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1529 writesame 0x14645b thru 0x14c039 data_size 0x1(0x5bdf bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1530 write 0xe2b9c9b thru 0xe2bbe6d (0x21d3 bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1531 write 0x99c288d thru 0x99cc309 (0x9a7d bytes) 2024-09-14T07:12:16.228 INFO:teuthology.orchestra.run.smithi071.stdout:1532 read 0x1f48889 thru 0x1f51a46 (0x91be bytes) 2024-09-14T07:12:16.229 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:16.229 INFO:teuthology.orchestra.run.smithi071.stdout:1534 clone 15 order 24 su 4194304 sc 15 2024-09-14T07:12:16.229 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:16.225+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:16.327 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:16.326+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:16.371 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:16.371 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:16.371 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:16.371 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:16.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:16.428 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:16.427+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:16.482 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:16.482 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:16.482 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:16.482 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:16.482 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:16.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:16.529 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:16.528+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:16.630 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:16.630+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:16.634 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.498267075000001, 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:16.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:16.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:16.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:16.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:16.642 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.942950552999999, 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:16.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:16.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8693 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1941504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.655467124999999, 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033512578000000001, 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.649 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8693 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977709+0000", 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977710+0000", 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3500000000000005e-07 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977713+0000", 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.123e-06 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977716+0000", 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9919999999999999e-06 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011124+0000", 2024-09-14T07:12:16.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033407729999999997 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011161+0000", 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6729e-05 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011222+0000", 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0961999999999997e-05 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.653 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8695 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1982464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.655344929, 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033512594, 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.654 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8695 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977831+0000", 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977832+0000", 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7800000000000001e-07 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977834+0000", 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2520000000000002e-06 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977840+0000", 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9619999999999998e-06 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977843+0000", 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0989999999999999e-06 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011245+0000", 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033401765 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011281+0000", 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5824999999999997e-05 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011344+0000", 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8696 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 2076672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.655328018000001, 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033630489999999999, 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8696 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977848+0000", 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0100000000000001e-07 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977849+0000", 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6500000000000008e-07 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977852+0000", 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.976e-06 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.977855+0000", 2024-09-14T07:12:16.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3199999999999998e-06 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011365+0000", 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033510256000000002 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011403+0000", 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7768000000000002e-05 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.011479+0000", 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6003999999999999e-05 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8853 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.654073065, 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033449174999999998, 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8853 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979103+0000", 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.84e-07 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979105+0000", 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1449999999999998e-06 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979108+0000", 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8710000000000001e-06 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979112+0000", 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2830000000000002e-06 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012548+0000", 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033436216999999997 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012552+0000", 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3749999999999996e-06 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8854 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.654061636, 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033459328000000003, 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8854 2024-09-14T07:12:16.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979114+0000", 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979115+0000", 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9299999999999999e-07 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979116+0000", 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6199999999999996e-07 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979119+0000", 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8789999999999999e-06 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979121+0000", 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.401e-06 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012569+0000", 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033448569999999997 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012574+0000", 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3229999999999999e-06 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8855 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.654052488, 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033472147000000001, 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8855 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.673 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979124+0000", 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.03e-07 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979125+0000", 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6899999999999996e-07 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979127+0000", 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.813e-06 2024-09-14T07:12:16.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979131+0000", 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1750000000000001e-06 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012592+0000", 2024-09-14T07:12:16.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033460999999999998 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012596+0000", 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1869999999999999e-06 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8856 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.654042613, 2024-09-14T07:12:16.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033482968000000002, 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8856 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979133+0000", 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979163+0000", 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9280000000000001e-05 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979165+0000", 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4169999999999999e-06 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979169+0000", 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1690000000000002e-06 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979173+0000", 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0210000000000001e-06 2024-09-14T07:12:16.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012612+0000", 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033438864999999998 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012616+0000", 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.216e-06 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.681 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:8857 3.d 3.5428c84d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.653998124999999, 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.03345882, 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 8857 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979178+0000", 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979611+0000", 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000433423 2024-09-14T07:12:16.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979617+0000", 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0750000000000003e-06 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979622+0000", 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9949999999999996e-06 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.979627+0000", 2024-09-14T07:12:16.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3290000000000004e-06 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012632+0000", 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033005372999999998 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.012637+0000", 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6249999999999998e-06 2024-09-14T07:12:16.685 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9390 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 847872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.61558219, 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033450345999999999, 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.686 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9390 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:16.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017594+0000", 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.58e-07 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017596+0000", 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.933e-06 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017602+0000", 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7089999999999999e-06 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017606+0000", 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5480000000000003e-06 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.050935+0000", 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033328363 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.050977+0000", 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1696999999999997e-05 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051044+0000", 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7737999999999994e-05 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.690 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9392 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 888832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615564312, 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033568649999999998, 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9392 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017612+0000", 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017614+0000", 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.708e-06 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017620+0000", 2024-09-14T07:12:16.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7100000000000004e-06 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017624+0000", 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6840000000000004e-06 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051070+0000", 2024-09-14T07:12:16.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033445526000000003 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051110+0000", 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0615999999999999e-05 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051180+0000", 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0092999999999995e-05 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.695 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9394 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 929792~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615536693999999, 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033671397999999998, 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.697 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9394 2024-09-14T07:12:16.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.697 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017639+0000", 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017640+0000", 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9599999999999999e-07 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017642+0000", 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0849999999999999e-06 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017650+0000", 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017655+0000", 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4249999999999997e-06 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051205+0000", 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033549686000000002 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051244+0000", 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319000000000001e-05 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051311+0000", 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6759000000000002e-05 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9396 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1024000~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615514811000001, 2024-09-14T07:12:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033788708000000001, 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9396 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017661+0000", 2024-09-14T07:12:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017662+0000", 2024-09-14T07:12:16.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000002e-07 2024-09-14T07:12:16.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017664+0000", 2024-09-14T07:12:16.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.773e-06 2024-09-14T07:12:16.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017670+0000", 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017674+0000", 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7140000000000001e-06 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051335+0000", 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033660836999999999 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051377+0000", 2024-09-14T07:12:16.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2080999999999999e-05 2024-09-14T07:12:16.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051450+0000", 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2856999999999997e-05 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9398 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1064960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615496200999999, 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033904561, 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9398 2024-09-14T07:12:16.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:16.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017680+0000", 2024-09-14T07:12:16.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.46e-07 2024-09-14T07:12:16.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017682+0000", 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8250000000000001e-06 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017688+0000", 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4890000000000003e-06 2024-09-14T07:12:16.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017692+0000", 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4970000000000003e-06 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051475+0000", 2024-09-14T07:12:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033782963999999999 2024-09-14T07:12:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051517+0000", 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2014999999999997e-05 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051584+0000", 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7424999999999999e-05 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9400 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1159168~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615478336000001, 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034021379999999997, 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9400 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017698+0000", 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1399999999999997e-07 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017700+0000", 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.871e-06 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017705+0000", 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2989999999999996e-06 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017711+0000", 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6389999999999997e-06 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051610+0000", 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033899171999999998 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051651+0000", 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1236999999999998e-05 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051719+0000", 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7748000000000003e-05 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9402 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1200128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615459831000001, 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034131720999999997, 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9402 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017716+0000", 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017717+0000", 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.22e-07 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017718+0000", 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7430000000000001e-06 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017724+0000", 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.57e-06 2024-09-14T07:12:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017728+0000", 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3000000000000003e-06 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051743+0000", 2024-09-14T07:12:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034015116999999997 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051783+0000", 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9904000000000003e-05 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051848+0000", 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4764999999999994e-05 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9404 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1294336~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615442352000001, 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034257163, 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9404 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017734+0000", 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8599999999999999e-07 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017736+0000", 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.826e-06 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017742+0000", 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017747+0000", 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.259e-06 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051873+0000", 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034125988000000003 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051918+0000", 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5368000000000003e-05 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.051991+0000", 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2721999999999999e-05 2024-09-14T07:12:16.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9406 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1335296~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615423302, 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034372278999999999, 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9406 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017753+0000", 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4600000000000005e-07 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017755+0000", 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017761+0000", 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8270000000000003e-06 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017766+0000", 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7979999999999996e-06 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052015+0000", 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034249479999999999 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052056+0000", 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0311000000000001e-05 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052125+0000", 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9451999999999998e-05 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9408 3.d 3:b213142a:::rbd_data.1182823d0fd0.0000000000000001:6 [read 1376256~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.615404955000001, 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.034485301000000003, 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:16.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9408 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.017771+0000", 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022916+0000", 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051447860000000002 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022920+0000", 2024-09-14T07:12:16.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022930+0000", 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8719999999999997e-06 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.022937+0000", 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.922e-06 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052150+0000", 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.029213214000000001 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052190+0000", 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0054e-05 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.052256+0000", 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6533999999999997e-05 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.742 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:16.743 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:16.743 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:16.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:16.746 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:16.744+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:16.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:12:16.846 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:16.845+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:16.852 INFO:teuthology.orchestra.run.smithi071.stdout:flattening image image_client.0-clone14 2024-09-14T07:12:16.885 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20438 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857541+0000", 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011224154, 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011248052, 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20438 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857541+0000", 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857541+0000", 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857541+0000", 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5000000000000003e-07 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857543+0000", 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.069e-06 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857550+0000", 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0780000000000001e-06 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857554+0000", 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5360000000000003e-06 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.889 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20496 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858576+0000", 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010188585999999999, 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010257283000000001, 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20496 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858576+0000", 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858576+0000", 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858577+0000", 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.05e-07 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858578+0000", 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1500000000000003e-07 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858580+0000", 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9110000000000002e-06 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858583+0000", 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3980000000000002e-06 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20564 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.893 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859222+0000", 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0095432050000000008, 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0096368340000000004, 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20564 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859222+0000", 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859222+0000", 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859222+0000", 2024-09-14T07:12:16.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6399999999999998e-07 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859224+0000", 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859230+0000", 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1020000000000002e-06 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859235+0000", 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.656e-06 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20623 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.897 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859924+0000", 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.008841359, 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089591570000000006, 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20623 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859924+0000", 2024-09-14T07:12:16.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859924+0000", 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859924+0000", 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5400000000000001e-07 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859929+0000", 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1919999999999996e-06 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859943+0000", 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3468999999999999e-05 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859949+0000", 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.879e-06 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20694 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860600+0000", 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081652559999999992, 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083077949999999998, 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20694 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860600+0000", 2024-09-14T07:12:16.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860600+0000", 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860600+0000", 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1199999999999999e-07 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860601+0000", 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7700000000000003e-07 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860604+0000", 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.982e-06 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860607+0000", 2024-09-14T07:12:16.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0510000000000001e-06 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20760 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861242+0000", 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0075232800000000002, 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076904290000000004, 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20760 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861242+0000", 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861242+0000", 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861242+0000", 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861244+0000", 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7910000000000001e-06 2024-09-14T07:12:16.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861250+0000", 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1829999999999999e-06 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861254+0000", 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3139999999999997e-06 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20821 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0069676460000000001, 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071845019999999997, 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20821 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:16.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861798+0000", 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861800+0000", 2024-09-14T07:12:16.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.956e-06 2024-09-14T07:12:16.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861807+0000", 2024-09-14T07:12:16.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250000000000002e-06 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861812+0000", 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5469999999999998e-06 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20439 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857560+0000", 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011205184999999999, 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011464548999999999, 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20439 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857560+0000", 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857560+0000", 2024-09-14T07:12:16.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857560+0000", 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5699999999999998e-07 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857562+0000", 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.801e-06 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857568+0000", 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5430000000000001e-06 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857572+0000", 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4279999999999998e-06 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20506 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.920 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858587+0000", 2024-09-14T07:12:16.920 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010177925000000001, 2024-09-14T07:12:16.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010483671999999999, 2024-09-14T07:12:16.920 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.920 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20506 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858587+0000", 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858587+0000", 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858587+0000", 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2300000000000002e-07 2024-09-14T07:12:16.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858589+0000", 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4410000000000001e-06 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858594+0000", 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0849999999999996e-06 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858598+0000", 2024-09-14T07:12:16.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9199999999999997e-06 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20565 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859241+0000", 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0095238730000000004, 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098716489999999997, 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20565 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859241+0000", 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859241+0000", 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859242+0000", 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6699999999999999e-07 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859243+0000", 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7400000000000001e-06 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859249+0000", 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8839999999999999e-06 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859254+0000", 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20624 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859956+0000", 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0088085179999999996, 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092014509999999994, 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20624 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859956+0000", 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859956+0000", 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859957+0000", 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859965+0000", 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4659999999999999e-06 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859973+0000", 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0660000000000004e-06 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859978+0000", 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8779999999999997e-06 2024-09-14T07:12:16.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20695 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860612+0000", 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081532199999999992, 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085891539999999999, 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20695 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860612+0000", 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860612+0000", 2024-09-14T07:12:16.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860612+0000", 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5600000000000001e-07 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860613+0000", 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0669999999999999e-06 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860617+0000", 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.49e-06 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860619+0000", 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4609999999999998e-06 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.935 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20762 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861261+0000", 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0075043949999999996, 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079884039999999993, 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20762 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861261+0000", 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861261+0000", 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861261+0000", 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:16.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861263+0000", 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8300000000000001e-06 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861269+0000", 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9490000000000001e-06 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861281+0000", 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1829e-05 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20823 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0069466859999999997, 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074747859999999998, 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.939 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20823 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861819+0000", 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.77e-07 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861820+0000", 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.792e-06 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861827+0000", 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8979999999999999e-06 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861832+0000", 2024-09-14T07:12:16.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3630000000000004e-06 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20440 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857577+0000", 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011187624, 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011763356000000001, 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.943 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20440 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857577+0000", 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857577+0000", 2024-09-14T07:12:16.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857578+0000", 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6399999999999998e-07 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857584+0000", 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5239999999999997e-06 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857591+0000", 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.365e-06 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857595+0000", 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3749999999999996e-06 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20507 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010161402, 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010782093, 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20507 2024-09-14T07:12:16.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8599999999999999e-07 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858606+0000", 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7129999999999999e-06 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858611+0000", 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7490000000000004e-06 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858615+0000", 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8089999999999999e-06 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.950 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20566 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859260+0000", 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0095047269999999993, 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010169175000000001, 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20566 2024-09-14T07:12:16.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859260+0000", 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859260+0000", 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859261+0000", 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1100000000000001e-07 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859263+0000", 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.843e-06 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859269+0000", 2024-09-14T07:12:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0390000000000001e-06 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859274+0000", 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0390000000000004e-06 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20635 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.954 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859985+0000", 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0087795249999999998, 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094881170000000008, 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20635 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859985+0000", 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859985+0000", 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859986+0000", 2024-09-14T07:12:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859988+0000", 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7209999999999999e-06 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859994+0000", 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0270000000000001e-06 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860003+0000", 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6690000000000001e-06 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20696 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860623+0000", 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081417439999999994, 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088928280000000002, 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20696 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860623+0000", 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860623+0000", 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860623+0000", 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860624+0000", 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5099999999999998e-07 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860627+0000", 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.965e-06 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860635+0000", 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6059999999999997e-06 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20764 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861288+0000", 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0074771409999999996, 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082745279999999997, 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20764 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861288+0000", 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861288+0000", 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861288+0000", 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8400000000000005e-07 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861291+0000", 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.181e-06 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861296+0000", 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9490000000000001e-06 2024-09-14T07:12:16.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861301+0000", 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4290000000000003e-06 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20441 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857602+0000", 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011163205000000001, 2024-09-14T07:12:16.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012008497999999999, 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20441 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857602+0000", 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857602+0000", 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857602+0000", 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5900000000000002e-07 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857604+0000", 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9649999999999998e-06 2024-09-14T07:12:16.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857610+0000", 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1229999999999997e-06 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857615+0000", 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5920000000000002e-06 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20508 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858619+0000", 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010145830999999999, 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011037714000000001, 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20508 2024-09-14T07:12:16.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858619+0000", 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858619+0000", 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858619+0000", 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4299999999999999e-07 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858625+0000", 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1619999999999999e-06 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858628+0000", 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4120000000000001e-06 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858635+0000", 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5130000000000002e-06 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20567 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859281+0000", 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0094836190000000004, 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010418214, 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20567 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.973 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859281+0000", 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859281+0000", 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859282+0000", 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859284+0000", 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859290+0000", 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0469999999999999e-06 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859294+0000", 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6480000000000002e-06 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.976 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20636 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860010+0000", 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0087551669999999995, 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097192509999999999, 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20636 2024-09-14T07:12:16.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860010+0000", 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860010+0000", 2024-09-14T07:12:16.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860010+0000", 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860012+0000", 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8109999999999999e-06 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860017+0000", 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860022+0000", 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5870000000000003e-06 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20697 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860638+0000", 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081266889999999994, 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091189659999999992, 2024-09-14T07:12:16.981 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20697 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860638+0000", 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860638+0000", 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860639+0000", 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860640+0000", 2024-09-14T07:12:16.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.06e-06 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860643+0000", 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0410000000000002e-06 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860645+0000", 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20765 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861307+0000", 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0074577890000000003, 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084872130000000004, 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.985 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20765 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861307+0000", 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861307+0000", 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861308+0000", 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8000000000000001e-07 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861309+0000", 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.778e-06 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861313+0000", 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4620000000000001e-06 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861315+0000", 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.553e-06 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20442 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857621+0000", 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011144087, 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012219723, 2024-09-14T07:12:16.989 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20442 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857621+0000", 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857621+0000", 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857621+0000", 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3200000000000001e-07 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857623+0000", 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6759999999999999e-06 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857629+0000", 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7620000000000001e-06 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857638+0000", 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2070000000000001e-06 2024-09-14T07:12:16.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20509 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858640+0000", 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010124974, 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011246772, 2024-09-14T07:12:16.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20509 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858640+0000", 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858640+0000", 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858640+0000", 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1600000000000002e-07 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:16.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858642+0000", 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.796e-06 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858648+0000", 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858653+0000", 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6410000000000001e-06 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20568 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859301+0000", 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0094644470000000008, 2024-09-14T07:12:16.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010638936, 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20568 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.998 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859301+0000", 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859301+0000", 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:16.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859301+0000", 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2399999999999999e-07 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859309+0000", 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8339999999999999e-06 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859315+0000", 2024-09-14T07:12:17.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4659999999999996e-06 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859320+0000", 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20637 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.001 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860028+0000", 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0087371889999999994, 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099597069999999999, 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20637 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860028+0000", 2024-09-14T07:12:17.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860028+0000", 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860028+0000", 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2300000000000002e-07 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860030+0000", 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.658e-06 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860035+0000", 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5319999999999997e-06 2024-09-14T07:12:17.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860041+0000", 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7049999999999996e-06 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20699 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860648+0000", 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081172680000000004, 2024-09-14T07:12:17.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093846869999999992, 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20699 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860648+0000", 2024-09-14T07:12:17.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860648+0000", 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860648+0000", 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860652+0000", 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6109999999999998e-06 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860655+0000", 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3450000000000002e-06 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860658+0000", 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.534e-06 2024-09-14T07:12:17.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20766 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861319+0000", 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0074464800000000001, 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087545520000000005, 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20766 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861319+0000", 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861319+0000", 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861319+0000", 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861320+0000", 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2999999999999999e-07 2024-09-14T07:12:17.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861323+0000", 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0400000000000001e-06 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861325+0000", 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3209999999999999e-06 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20451 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857644+0000", 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011120781, 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012476292, 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.014 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20451 2024-09-14T07:12:17.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.014 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857644+0000", 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857644+0000", 2024-09-14T07:12:17.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857645+0000", 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.84e-07 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857647+0000", 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9309999999999998e-06 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857652+0000", 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9510000000000003e-06 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857657+0000", 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6059999999999996e-06 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20510 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858658+0000", 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010106566000000001, 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011508060000000001, 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20510 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858658+0000", 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858658+0000", 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858659+0000", 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9400000000000001e-07 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858661+0000", 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.764e-06 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858667+0000", 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4030000000000004e-06 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858672+0000", 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5800000000000002e-06 2024-09-14T07:12:17.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20569 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859327+0000", 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0094381440000000007, 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010924550999999999, 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.021 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20569 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859327+0000", 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859327+0000", 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859327+0000", 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-07 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859329+0000", 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0150000000000002e-06 2024-09-14T07:12:17.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859335+0000", 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0109999999999997e-06 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859340+0000", 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4510000000000002e-06 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20638 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860047+0000", 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0087181970000000004, 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010250070999999999, 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20638 2024-09-14T07:12:17.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860047+0000", 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860047+0000", 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860047+0000", 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860054+0000", 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0149999999999998e-06 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860060+0000", 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.241e-06 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860065+0000", 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20705 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860664+0000", 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081010969999999998, 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0096791010000000007, 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20705 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860664+0000", 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860664+0000", 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860664+0000", 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.41e-07 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860666+0000", 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6169999999999999e-06 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860673+0000", 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.72e-06 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860676+0000", 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.134e-06 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20767 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861328+0000", 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0074371610000000003, 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090652920000000008, 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20767 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861328+0000", 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861328+0000", 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861328+0000", 2024-09-14T07:12:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1e-07 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861329+0000", 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5000000000000001e-07 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861332+0000", 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8609999999999998e-06 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861334+0000", 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3779999999999999e-06 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20453 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857663+0000", 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011102290000000001, 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012761905, 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20453 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857663+0000", 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857663+0000", 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857663+0000", 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857665+0000", 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.79e-06 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857673+0000", 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4440000000000008e-06 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857678+0000", 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5229999999999997e-06 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20511 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858678+0000", 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010087423999999999, 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011782944, 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20511 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858678+0000", 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858678+0000", 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858678+0000", 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858683+0000", 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3000000000000001e-06 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858690+0000", 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.516e-06 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858695+0000", 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0710000000000002e-06 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20570 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859346+0000", 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0094190669999999997, 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011159021, 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20570 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859346+0000", 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859346+0000", 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859346+0000", 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.01e-07 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859348+0000", 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8080000000000001e-06 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859354+0000", 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7599999999999999e-06 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859358+0000", 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.425e-06 2024-09-14T07:12:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20639 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860071+0000", 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086936889999999992, 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010469027000000001, 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20639 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860071+0000", 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860071+0000", 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860072+0000", 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1100000000000001e-07 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860073+0000", 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.759e-06 2024-09-14T07:12:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860079+0000", 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.57e-06 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860083+0000", 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1570000000000002e-06 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20707 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860679+0000", 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0080856350000000007, 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098991779999999998, 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20707 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.051 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860679+0000", 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860679+0000", 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860680+0000", 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860686+0000", 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5320000000000003e-06 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860692+0000", 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7270000000000004e-06 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860698+0000", 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2389999999999999e-06 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20768 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861337+0000", 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0074281709999999999, 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009274203, 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20768 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861337+0000", 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861337+0000", 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861337+0000", 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861344+0000", 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1010000000000003e-06 2024-09-14T07:12:17.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861348+0000", 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861353+0000", 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2410000000000003e-06 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20454 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857685+0000", 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011080499000000001, 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012955467, 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20454 2024-09-14T07:12:17.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857685+0000", 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857685+0000", 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857685+0000", 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857689+0000", 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9419999999999997e-06 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857695+0000", 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8950000000000003e-06 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857699+0000", 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5739999999999997e-06 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20512 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858701+0000", 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010063624, 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011977856, 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20512 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858701+0000", 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858701+0000", 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858702+0000", 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858704+0000", 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9149999999999999e-06 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858710+0000", 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4459999999999998e-06 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858715+0000", 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:12:17.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20579 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859365+0000", 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0094002100000000009, 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011338859, 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.065 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20579 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859365+0000", 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859365+0000", 2024-09-14T07:12:17.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859365+0000", 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.01e-07 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859367+0000", 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.905e-06 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859373+0000", 2024-09-14T07:12:17.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0349999999999998e-06 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859386+0000", 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3094e-05 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20640 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860089+0000", 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086756149999999994, 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010639335999999999, 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20640 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860089+0000", 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860089+0000", 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860090+0000", 2024-09-14T07:12:17.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-07 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860092+0000", 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8330000000000001e-06 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860096+0000", 2024-09-14T07:12:17.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0130000000000004e-06 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860098+0000", 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5780000000000001e-06 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.072 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20709 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860714+0000", 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0080508750000000007, 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010054512, 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20709 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860714+0000", 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860714+0000", 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860715+0000", 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-07 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860717+0000", 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0959999999999999e-06 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860722+0000", 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5779999999999998e-06 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860727+0000", 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6349999999999997e-06 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20769 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861359+0000", 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0074061680000000003, 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094384020000000002, 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20769 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861359+0000", 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861359+0000", 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861359+0000", 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4699999999999998e-07 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861363+0000", 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9589999999999997e-06 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861366+0000", 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1530000000000001e-06 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861369+0000", 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20455 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857807+0000", 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010957751, 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013018389, 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.080 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20455 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857807+0000", 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857807+0000", 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857808+0000", 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0100000000000004e-07 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857811+0000", 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1889999999999999e-06 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857820+0000", 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1430000000000004e-06 2024-09-14T07:12:17.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857833+0000", 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.26e-05 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20513 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858721+0000", 2024-09-14T07:12:17.083 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010043944000000001, 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012149359, 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20513 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858721+0000", 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858721+0000", 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858721+0000", 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:17.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858723+0000", 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9989999999999998e-06 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858730+0000", 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3280000000000002e-06 2024-09-14T07:12:17.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858740+0000", 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0691e-05 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20581 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859393+0000", 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.009372188, 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011505293, 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20581 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859393+0000", 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859393+0000", 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859393+0000", 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.77e-07 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859398+0000", 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8899999999999998e-06 2024-09-14T07:12:17.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859404+0000", 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2530000000000001e-06 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859409+0000", 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.561e-06 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20641 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860103+0000", 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086616049999999993, 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01081765, 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.092 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20641 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860103+0000", 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860103+0000", 2024-09-14T07:12:17.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860104+0000", 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860105+0000", 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.531e-06 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860111+0000", 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3210000000000004e-06 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860115+0000", 2024-09-14T07:12:17.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.216e-06 2024-09-14T07:12:17.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.096 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20711 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860733+0000", 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0080322069999999995, 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010221691999999999, 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20711 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860733+0000", 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860733+0000", 2024-09-14T07:12:17.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860733+0000", 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4999999999999998e-07 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860735+0000", 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.626e-06 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860740+0000", 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5430000000000001e-06 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860744+0000", 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20770 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861373+0000", 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0073924699999999999, 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0096238910000000007, 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20770 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861373+0000", 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861373+0000", 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861373+0000", 2024-09-14T07:12:17.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2099999999999998e-07 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861378+0000", 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.147e-06 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861384+0000", 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861388+0000", 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3449999999999999e-06 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20456 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857847+0000", 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010917759000000001, 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013201121, 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.104 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20456 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857847+0000", 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857847+0000", 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857848+0000", 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5899999999999996e-07 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857850+0000", 2024-09-14T07:12:17.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.351e-06 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857857+0000", 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7479999999999996e-06 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857862+0000", 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.865e-06 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20514 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858746+0000", 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.01001873, 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012326475999999999, 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20514 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.109 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858746+0000", 2024-09-14T07:12:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858746+0000", 2024-09-14T07:12:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858747+0000", 2024-09-14T07:12:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7599999999999998e-07 2024-09-14T07:12:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858748+0000", 2024-09-14T07:12:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.437e-06 2024-09-14T07:12:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858752+0000", 2024-09-14T07:12:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0380000000000001e-06 2024-09-14T07:12:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858755+0000", 2024-09-14T07:12:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:12:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20582 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859415+0000", 2024-09-14T07:12:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.009350021, 2024-09-14T07:12:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011683264, 2024-09-14T07:12:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20582 2024-09-14T07:12:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859415+0000", 2024-09-14T07:12:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859415+0000", 2024-09-14T07:12:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859415+0000", 2024-09-14T07:12:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859417+0000", 2024-09-14T07:12:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7579999999999999e-06 2024-09-14T07:12:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859423+0000", 2024-09-14T07:12:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1419999999999998e-06 2024-09-14T07:12:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859428+0000", 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5190000000000003e-06 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20642 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860121+0000", 2024-09-14T07:12:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086441620000000004, 2024-09-14T07:12:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011014247, 2024-09-14T07:12:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20642 2024-09-14T07:12:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860121+0000", 2024-09-14T07:12:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860121+0000", 2024-09-14T07:12:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860121+0000", 2024-09-14T07:12:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2500000000000001e-07 2024-09-14T07:12:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860123+0000", 2024-09-14T07:12:17.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9250000000000002e-06 2024-09-14T07:12:17.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860129+0000", 2024-09-14T07:12:17.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8499999999999999e-06 2024-09-14T07:12:17.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860133+0000", 2024-09-14T07:12:17.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3989999999999997e-06 2024-09-14T07:12:17.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.131 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.132 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20712 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.132 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860750+0000", 2024-09-14T07:12:17.132 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0080150210000000006, 2024-09-14T07:12:17.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010433919, 2024-09-14T07:12:17.133 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.133 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.134 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20712 2024-09-14T07:12:17.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.134 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860750+0000", 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860750+0000", 2024-09-14T07:12:17.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860750+0000", 2024-09-14T07:12:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4999999999999998e-07 2024-09-14T07:12:17.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860752+0000", 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4920000000000001e-06 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860758+0000", 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9379999999999997e-06 2024-09-14T07:12:17.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860763+0000", 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3040000000000004e-06 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20779 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861395+0000", 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0073697099999999998, 2024-09-14T07:12:17.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098348979999999999, 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20779 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861395+0000", 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861395+0000", 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861396+0000", 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1799999999999995e-07 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861398+0000", 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.829e-06 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861404+0000", 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1109999999999996e-06 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861408+0000", 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5000000000000001e-06 2024-09-14T07:12:17.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20457 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857869+0000", 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010896372, 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013411693000000001, 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.142 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20457 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857869+0000", 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857869+0000", 2024-09-14T07:12:17.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857869+0000", 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857871+0000", 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8810000000000001e-06 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857877+0000", 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6969999999999998e-06 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857881+0000", 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4909999999999999e-06 2024-09-14T07:12:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20515 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858758+0000", 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010007354, 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012568113000000001, 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20515 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858758+0000", 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858758+0000", 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858758+0000", 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858759+0000", 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0249999999999999e-06 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858762+0000", 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.118e-06 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858764+0000", 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.351e-06 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20583 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859434+0000", 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0093315010000000007, 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011933246999999999, 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20583 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.150 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859434+0000", 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859434+0000", 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859434+0000", 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859442+0000", 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7100000000000007e-06 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859448+0000", 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4450000000000001e-06 2024-09-14T07:12:17.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859453+0000", 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.651e-06 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20643 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860140+0000", 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086253619999999993, 2024-09-14T07:12:17.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011272597000000001, 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20643 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860140+0000", 2024-09-14T07:12:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860140+0000", 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860140+0000", 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860142+0000", 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0619999999999999e-06 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860148+0000", 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7640000000000002e-06 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860152+0000", 2024-09-14T07:12:17.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1969999999999998e-06 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20713 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860769+0000", 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0079964509999999999, 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010692605000000001, 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20713 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860769+0000", 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860769+0000", 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860769+0000", 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4400000000000001e-07 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860770+0000", 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659999999999999e-06 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860776+0000", 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6840000000000001e-06 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860781+0000", 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20780 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861429+0000", 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0073356569999999998, 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010076125999999999, 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20780 2024-09-14T07:12:17.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861429+0000", 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861429+0000", 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861430+0000", 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9699999999999996e-07 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861432+0000", 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.902e-06 2024-09-14T07:12:17.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861436+0000", 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4939999999999997e-06 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861444+0000", 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1859999999999992e-06 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20458 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857887+0000", 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010877862, 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013666833, 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20458 2024-09-14T07:12:17.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857887+0000", 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857887+0000", 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857888+0000", 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8000000000000001e-07 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857889+0000", 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.829e-06 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857895+0000", 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5099999999999998e-06 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857901+0000", 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9630000000000003e-06 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20525 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858767+0000", 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099977360000000001, 2024-09-14T07:12:17.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012892022, 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20525 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858767+0000", 2024-09-14T07:12:17.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858767+0000", 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858767+0000", 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.16e-07 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858768+0000", 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6899999999999996e-07 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858771+0000", 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.886e-06 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858774+0000", 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3039999999999999e-06 2024-09-14T07:12:17.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20584 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859459+0000", 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0093060850000000004, 2024-09-14T07:12:17.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012246819000000001, 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20584 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859459+0000", 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859459+0000", 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859459+0000", 2024-09-14T07:12:17.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859461+0000", 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6959999999999999e-06 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859467+0000", 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859471+0000", 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3379999999999998e-06 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20654 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860158+0000", 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086066920000000009, 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011597532000000001, 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20654 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860158+0000", 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860158+0000", 2024-09-14T07:12:17.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860159+0000", 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7399999999999999e-07 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860160+0000", 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6559999999999999e-06 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860166+0000", 2024-09-14T07:12:17.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2140000000000004e-06 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860177+0000", 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1318000000000001e-05 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20714 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860786+0000", 2024-09-14T07:12:17.181 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0079789230000000006, 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011005012999999999, 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20714 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860786+0000", 2024-09-14T07:12:17.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860786+0000", 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860786+0000", 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3299999999999998e-07 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860788+0000", 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5269999999999999e-06 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860794+0000", 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0809999999999999e-06 2024-09-14T07:12:17.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860800+0000", 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5049999999999998e-06 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20781 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861449+0000", 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0073159389999999996, 2024-09-14T07:12:17.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010369628000000001, 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20781 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861449+0000", 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861449+0000", 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861449+0000", 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4799999999999999e-07 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861451+0000", 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1829999999999999e-06 2024-09-14T07:12:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861454+0000", 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.151e-06 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861456+0000", 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3870000000000002e-06 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20459 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857907+0000", 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010857741000000001, 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01395385, 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20459 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857907+0000", 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857907+0000", 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857908+0000", 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857910+0000", 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.857e-06 2024-09-14T07:12:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857915+0000", 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857920+0000", 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4000000000000002e-06 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20526 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858777+0000", 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099884250000000004, 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013135163, 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20526 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858777+0000", 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858777+0000", 2024-09-14T07:12:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858777+0000", 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1e-07 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858778+0000", 2024-09-14T07:12:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4900000000000004e-07 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858781+0000", 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.92e-06 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858787+0000", 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1589999999999998e-06 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20585 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859477+0000", 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0092879680000000006, 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012476322999999999, 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20585 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859477+0000", 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859477+0000", 2024-09-14T07:12:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859477+0000", 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3799999999999998e-07 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859479+0000", 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.624e-06 2024-09-14T07:12:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859489+0000", 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5799999999999998e-06 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859499+0000", 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9899999999999992e-06 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20655 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860184+0000", 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0085810020000000008, 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011795699999999999, 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20655 2024-09-14T07:12:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860184+0000", 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860184+0000", 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860185+0000", 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0100000000000005e-07 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860190+0000", 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860197+0000", 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2600000000000002e-06 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860201+0000", 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9189999999999998e-06 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20715 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860805+0000", 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0079599570000000001, 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011208956000000001, 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20715 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860805+0000", 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860805+0000", 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860805+0000", 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.65e-07 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860807+0000", 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7090000000000001e-06 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860813+0000", 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5929999999999996e-06 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860817+0000", 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4819999999999996e-06 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20782 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861459+0000", 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0073061209999999996, 2024-09-14T07:12:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010581781, 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20782 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861459+0000", 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861459+0000", 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861459+0000", 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.03e-07 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861460+0000", 2024-09-14T07:12:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.09e-07 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861463+0000", 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1250000000000001e-06 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861465+0000", 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3439999999999999e-06 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20460 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857926+0000", 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010839441999999999, 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014156765999999999, 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.213 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20460 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857926+0000", 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857926+0000", 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857926+0000", 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9900000000000001e-07 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857934+0000", 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7009999999999996e-06 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857944+0000", 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0825999999999999e-05 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857949+0000", 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8409999999999999e-06 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20527 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858790+0000", 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099746309999999994, 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013334597, 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20527 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.217 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858790+0000", 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858790+0000", 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858791+0000", 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858792+0000", 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9800000000000002e-07 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858795+0000", 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0599999999999999e-06 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858797+0000", 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-06 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20586 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859506+0000", 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0092594889999999992, 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012666060999999999, 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20586 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859506+0000", 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859506+0000", 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859506+0000", 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2100000000000002e-07 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859508+0000", 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.092e-06 2024-09-14T07:12:17.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859515+0000", 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5080000000000002e-06 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859519+0000", 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3789999999999999e-06 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20656 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860208+0000", 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0085566600000000007, 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012008852, 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20656 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.224 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860208+0000", 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860208+0000", 2024-09-14T07:12:17.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860209+0000", 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2599999999999998e-07 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860211+0000", 2024-09-14T07:12:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.813e-06 2024-09-14T07:12:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860216+0000", 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.507e-06 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860219+0000", 2024-09-14T07:12:17.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9399999999999998e-06 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20717 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860823+0000", 2024-09-14T07:12:17.229 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0079425020000000006, 2024-09-14T07:12:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011445940999999999, 2024-09-14T07:12:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.230 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20717 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860823+0000", 2024-09-14T07:12:17.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860823+0000", 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860823+0000", 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.39e-07 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860824+0000", 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.449e-06 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860830+0000", 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2820000000000004e-06 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860834+0000", 2024-09-14T07:12:17.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5199999999999999e-06 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20783 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861468+0000", 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0072967350000000004, 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010845863000000001, 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20783 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861468+0000", 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861468+0000", 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861468+0000", 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.05e-07 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861469+0000", 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5700000000000001e-07 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861472+0000", 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9349999999999999e-06 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861475+0000", 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20469 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857957+0000", 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010808287, 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014410806999999999, 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20469 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857957+0000", 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857957+0000", 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857957+0000", 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857959+0000", 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2220000000000001e-06 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857965+0000", 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.066e-06 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857970+0000", 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5920000000000002e-06 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20528 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858800+0000", 2024-09-14T07:12:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099651180000000002, 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013613455999999999, 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20528 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858800+0000", 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858800+0000", 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858800+0000", 2024-09-14T07:12:17.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858806+0000", 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6099999999999997e-06 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858811+0000", 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4829999999999999e-06 2024-09-14T07:12:17.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858815+0000", 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1899999999999997e-06 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20587 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859525+0000", 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0092402270000000002, 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012937796999999999, 2024-09-14T07:12:17.246 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20587 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859525+0000", 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859525+0000", 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859525+0000", 2024-09-14T07:12:17.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859527+0000", 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7010000000000001e-06 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859533+0000", 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8069999999999996e-06 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859537+0000", 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20657 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860223+0000", 2024-09-14T07:12:17.250 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0085420380000000001, 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012284168999999999, 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20657 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860223+0000", 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860223+0000", 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860223+0000", 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.48e-07 2024-09-14T07:12:17.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860224+0000", 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0359999999999999e-06 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860227+0000", 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9299999999999999e-06 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860230+0000", 2024-09-14T07:12:17.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3609999999999999e-06 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20724 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860840+0000", 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0079253680000000003, 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011717853, 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20724 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860840+0000", 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860840+0000", 2024-09-14T07:12:17.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860840+0000", 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7e-07 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860842+0000", 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5549999999999999e-06 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860846+0000", 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9139999999999999e-06 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860851+0000", 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1500000000000001e-06 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20784 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861477+0000", 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0072875320000000002, 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011126769999999999, 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20784 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861477+0000", 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861477+0000", 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861478+0000", 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861479+0000", 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4099999999999997e-07 2024-09-14T07:12:17.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861481+0000", 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9340000000000002e-06 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861484+0000", 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3640000000000002e-06 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20471 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858245+0000", 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010519676, 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014410821000000001, 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20471 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858245+0000", 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858245+0000", 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858246+0000", 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5099999999999999e-07 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858249+0000", 2024-09-14T07:12:17.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1779999999999999e-06 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858258+0000", 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9490000000000002e-06 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858264+0000", 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9859999999999999e-06 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20529 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858822+0000", 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099433479999999994, 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013870835, 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20529 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.267 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858822+0000", 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858822+0000", 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858822+0000", 2024-09-14T07:12:17.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-07 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858824+0000", 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9999999999999999e-06 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858830+0000", 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6860000000000003e-06 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858834+0000", 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239999999999997e-06 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20588 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859543+0000", 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0092221500000000001, 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013195938000000001, 2024-09-14T07:12:17.270 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20588 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859543+0000", 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859543+0000", 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859543+0000", 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859550+0000", 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7889999999999997e-06 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859556+0000", 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2859999999999996e-06 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859561+0000", 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6789999999999996e-06 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20658 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.274 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860232+0000", 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0085325520000000005, 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012552933, 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20658 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860232+0000", 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860232+0000", 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860233+0000", 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860234+0000", 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6899999999999996e-07 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860236+0000", 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.841e-06 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860239+0000", 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.368e-06 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20726 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860862+0000", 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0079025929999999994, 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011971278, 2024-09-14T07:12:17.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20726 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860862+0000", 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860862+0000", 2024-09-14T07:12:17.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860863+0000", 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1399999999999997e-07 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860874+0000", 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1307e-05 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860882+0000", 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0809999999999994e-06 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860893+0000", 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1017e-05 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20785 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0072783819999999999, 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011392625, 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20785 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861488+0000", 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5600000000000004e-07 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861491+0000", 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8550000000000002e-06 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861493+0000", 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3690000000000001e-06 2024-09-14T07:12:17.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20472 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858274+0000", 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010490886, 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014688118, 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20472 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858274+0000", 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858274+0000", 2024-09-14T07:12:17.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3000000000000001e-07 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858277+0000", 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.119e-06 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858283+0000", 2024-09-14T07:12:17.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0349999999999998e-06 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858288+0000", 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8620000000000002e-06 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20530 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858840+0000", 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099248459999999993, 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014170059, 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20530 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858840+0000", 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858840+0000", 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858841+0000", 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3700000000000001e-07 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858842+0000", 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.832e-06 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858848+0000", 2024-09-14T07:12:17.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9390000000000002e-06 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858853+0000", 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4569999999999998e-06 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20598 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859568+0000", 2024-09-14T07:12:17.294 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0091969100000000008, 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013502233000000001, 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20598 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859568+0000", 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859568+0000", 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859569+0000", 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5900000000000002e-07 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859571+0000", 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0310000000000001e-06 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859577+0000", 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2190000000000001e-06 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859588+0000", 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0971e-05 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20659 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860242+0000", 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0085233400000000008, 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012880457, 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20659 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860242+0000", 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860242+0000", 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860242+0000", 2024-09-14T07:12:17.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7799999999999997e-07 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860250+0000", 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.123e-06 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860256+0000", 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8109999999999999e-06 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860265+0000", 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20728 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860901+0000", 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0078638749999999993, 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012267109999999999, 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.302 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20728 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860901+0000", 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860901+0000", 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860902+0000", 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3600000000000004e-07 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860907+0000", 2024-09-14T07:12:17.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2179999999999998e-06 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860915+0000", 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9859999999999994e-06 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860920+0000", 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8199999999999996e-06 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20786 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861496+0000", 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.007268549, 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011720784, 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20786 2024-09-14T07:12:17.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861496+0000", 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861496+0000", 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861497+0000", 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1899999999999998e-07 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861498+0000", 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.325e-06 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861505+0000", 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0029999999999997e-06 2024-09-14T07:12:17.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861510+0000", 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4020000000000004e-06 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20473 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858294+0000", 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010470909, 2024-09-14T07:12:17.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014967202000000001, 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.310 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20473 2024-09-14T07:12:17.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.311 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858294+0000", 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858294+0000", 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858294+0000", 2024-09-14T07:12:17.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3099999999999999e-07 2024-09-14T07:12:17.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858296+0000", 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.869e-06 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858302+0000", 2024-09-14T07:12:17.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6130000000000003e-06 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858313+0000", 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1508999999999999e-05 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.316 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20531 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.316 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858859+0000", 2024-09-14T07:12:17.316 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0099061970000000003, 2024-09-14T07:12:17.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014442534999999999, 2024-09-14T07:12:17.317 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.317 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.317 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.317 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.318 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20531 2024-09-14T07:12:17.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.318 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858859+0000", 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858859+0000", 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858859+0000", 2024-09-14T07:12:17.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1100000000000001e-07 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858861+0000", 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.858e-06 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858867+0000", 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8470000000000001e-06 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858871+0000", 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5000000000000001e-06 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20599 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859594+0000", 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0091706819999999994, 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013741819000000001, 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20599 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859594+0000", 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859594+0000", 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859595+0000", 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859597+0000", 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9549999999999999e-06 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859603+0000", 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1249999999999998e-06 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859607+0000", 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6199999999999998e-06 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20660 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860272+0000", 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0084931999999999994, 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013101840999999999, 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20660 2024-09-14T07:12:17.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.328 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860272+0000", 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860272+0000", 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860272+0000", 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4099999999999999e-07 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860274+0000", 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.928e-06 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860280+0000", 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9170000000000003e-06 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860285+0000", 2024-09-14T07:12:17.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6129999999999997e-06 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20729 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860927+0000", 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0078380810000000002, 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012473433000000001, 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20729 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860927+0000", 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860927+0000", 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860927+0000", 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5200000000000002e-07 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860943+0000", 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5387e-05 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860951+0000", 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3720000000000005e-06 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860955+0000", 2024-09-14T07:12:17.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6279999999999998e-06 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20787 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0072491389999999999, 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011918171, 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20787 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861518+0000", 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:17.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861524+0000", 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861529+0000", 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3719999999999998e-06 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20474 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858320+0000", 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010444556000000001, 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015150452, 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20474 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858320+0000", 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858320+0000", 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858321+0000", 2024-09-14T07:12:17.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6600000000000002e-07 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858323+0000", 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0600000000000002e-06 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858329+0000", 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080000000000002e-06 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858334+0000", 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.831e-06 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20532 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858878+0000", 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0098872600000000001, 2024-09-14T07:12:17.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014636689, 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20532 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858878+0000", 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858878+0000", 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858878+0000", 2024-09-14T07:12:17.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.39e-07 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858883+0000", 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1730000000000003e-06 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858890+0000", 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4880000000000004e-06 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858894+0000", 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6229999999999996e-06 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20600 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859619+0000", 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0091459739999999994, 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013930569, 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20600 2024-09-14T07:12:17.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859619+0000", 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859619+0000", 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859620+0000", 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0299999999999999e-07 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859621+0000", 2024-09-14T07:12:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.877e-06 2024-09-14T07:12:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859628+0000", 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2129999999999996e-06 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859632+0000", 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4710000000000001e-06 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20661 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860291+0000", 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0084742919999999996, 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013285287, 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20661 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860291+0000", 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860291+0000", 2024-09-14T07:12:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860291+0000", 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3299999999999998e-07 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860293+0000", 2024-09-14T07:12:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.579e-06 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860298+0000", 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5300000000000004e-06 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860303+0000", 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5009999999999998e-06 2024-09-14T07:12:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20730 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860962+0000", 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0078032489999999999, 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012636823, 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20730 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860962+0000", 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860962+0000", 2024-09-14T07:12:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860962+0000", 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5299999999999999e-07 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860964+0000", 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0320000000000002e-06 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860968+0000", 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6030000000000001e-06 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860972+0000", 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2969999999999997e-06 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20788 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0072315799999999996, 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012094311, 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20788 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861534+0000", 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861540+0000", 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9309999999999996e-06 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861543+0000", 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861546+0000", 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20475 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858339+0000", 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010425739, 2024-09-14T07:12:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015339637, 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20475 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858339+0000", 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858339+0000", 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858340+0000", 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858341+0000", 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7540000000000001e-06 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858347+0000", 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8699999999999997e-06 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858352+0000", 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3630000000000004e-06 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20533 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858901+0000", 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0098642920000000002, 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014824087999999999, 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20533 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858901+0000", 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858901+0000", 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858901+0000", 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858911+0000", 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6719999999999999e-06 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858917+0000", 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858922+0000", 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9180000000000002e-06 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20601 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859654+0000", 2024-09-14T07:12:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0091107740000000003, 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01411896, 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20601 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859654+0000", 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859654+0000", 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859655+0000", 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859657+0000", 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0140000000000001e-06 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859663+0000", 2024-09-14T07:12:17.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7020000000000004e-06 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859668+0000", 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8740000000000003e-06 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20663 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860308+0000", 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0084568939999999995, 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013510292, 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20663 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860308+0000", 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860308+0000", 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860308+0000", 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7500000000000001e-07 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860310+0000", 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4869999999999999e-06 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860316+0000", 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.626e-06 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860320+0000", 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5820000000000003e-06 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20731 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860978+0000", 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0077874620000000002, 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012889437, 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20731 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860978+0000", 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860978+0000", 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860978+0000", 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860980+0000", 2024-09-14T07:12:17.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.762e-06 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860986+0000", 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0079999999999999e-06 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860990+0000", 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3510000000000004e-06 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20798 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0072158430000000004, 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012363772, 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20798 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861550+0000", 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.017e-06 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861553+0000", 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.909e-06 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861559+0000", 2024-09-14T07:12:17.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20476 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858357+0000", 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010407558000000001, 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015615502999999999, 2024-09-14T07:12:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20476 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858357+0000", 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858357+0000", 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858358+0000", 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858360+0000", 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.739e-06 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858365+0000", 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8479999999999997e-06 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858370+0000", 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4020000000000004e-06 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20534 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858929+0000", 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0098364009999999998, 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015083663000000001, 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20534 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858929+0000", 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858929+0000", 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858929+0000", 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.84e-07 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858931+0000", 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858946+0000", 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4973e-05 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858951+0000", 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9570000000000001e-06 2024-09-14T07:12:17.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20602 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859675+0000", 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0090904639999999995, 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014364604, 2024-09-14T07:12:17.396 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20602 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859675+0000", 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859675+0000", 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859675+0000", 2024-09-14T07:12:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000002e-07 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859680+0000", 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6600000000000003e-06 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859686+0000", 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.229e-06 2024-09-14T07:12:17.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859690+0000", 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6199999999999998e-06 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.400 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20671 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860326+0000", 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0084394789999999997, 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013747751000000001, 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20671 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860326+0000", 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860326+0000", 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860326+0000", 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.34e-07 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860327+0000", 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-06 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860333+0000", 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5130000000000004e-06 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860346+0000", 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3354e-05 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20732 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860997+0000", 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.007767833, 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013109855, 2024-09-14T07:12:17.404 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20732 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860997+0000", 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860997+0000", 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860998+0000", 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:17.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860999+0000", 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6899999999999999e-06 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861006+0000", 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4500000000000001e-06 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861022+0000", 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6200000000000001e-05 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20799 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0071994349999999997, 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012575705, 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20799 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861567+0000", 2024-09-14T07:12:17.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861572+0000", 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9609999999999996e-06 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861576+0000", 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20418 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857311+0000", 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011453715999999999, 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016859801000000001, 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20418 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.412 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857311+0000", 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857311+0000", 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857312+0000", 2024-09-14T07:12:17.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8000000000000001e-07 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857313+0000", 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.809e-06 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857319+0000", 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8699999999999997e-06 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857324+0000", 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4270000000000001e-06 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.873924+0000", 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016600674999999999 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.874016+0000", 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1787999999999996e-05 2024-09-14T07:12:17.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20477 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858384+0000", 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010381468, 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015815109000000001, 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20477 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858384+0000", 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858384+0000", 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858384+0000", 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858386+0000", 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9709999999999998e-06 2024-09-14T07:12:17.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858392+0000", 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1580000000000002e-06 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858397+0000", 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.651e-06 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20544 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858958+0000", 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0098075100000000002, 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0152867, 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20544 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858958+0000", 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858958+0000", 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858958+0000", 2024-09-14T07:12:17.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1100000000000001e-07 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858960+0000", 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858966+0000", 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1890000000000004e-06 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858976+0000", 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.028e-05 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20603 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859696+0000", 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0090686389999999999, 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014594962, 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20603 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859696+0000", 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859696+0000", 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859697+0000", 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859699+0000", 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7039999999999999e-06 2024-09-14T07:12:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859704+0000", 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9510000000000003e-06 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859709+0000", 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3950000000000003e-06 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20673 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860353+0000", 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0084119360000000001, 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013988242, 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20673 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860353+0000", 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860353+0000", 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860353+0000", 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2199999999999999e-07 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860356+0000", 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0389999999999999e-06 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860361+0000", 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6380000000000001e-06 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860366+0000", 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.254e-06 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20733 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861033+0000", 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0077318780000000002, 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013355175, 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20733 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861033+0000", 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861033+0000", 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861034+0000", 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861036+0000", 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1229999999999998e-06 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861042+0000", 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2439999999999998e-06 2024-09-14T07:12:17.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861047+0000", 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.434 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20800 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0071828600000000001, 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012852567000000001, 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20800 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861584+0000", 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7940000000000001e-06 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861596+0000", 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2092e-05 2024-09-14T07:12:17.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861602+0000", 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.438 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20419 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857330+0000", 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011434804, 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017155127999999999, 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20419 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857330+0000", 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857330+0000", 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857331+0000", 2024-09-14T07:12:17.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-07 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857333+0000", 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857338+0000", 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8170000000000004e-06 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857344+0000", 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8699999999999997e-06 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.874486+0000", 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017141694999999998 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20478 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858403+0000", 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010361662000000001, 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016115516999999999, 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20478 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858403+0000", 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858403+0000", 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858404+0000", 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8700000000000001e-07 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858405+0000", 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.756e-06 2024-09-14T07:12:17.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858411+0000", 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858421+0000", 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0030000000000001e-05 2024-09-14T07:12:17.446 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20545 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858983+0000", 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.009782008, 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015710608000000001, 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.447 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20545 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858983+0000", 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858983+0000", 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858983+0000", 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858985+0000", 2024-09-14T07:12:17.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0090000000000002e-06 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858995+0000", 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5210000000000008e-06 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859000+0000", 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.989e-06 2024-09-14T07:12:17.450 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20604 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859715+0000", 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0090504699999999997, 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015010801000000001, 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.451 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20604 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859715+0000", 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859715+0000", 2024-09-14T07:12:17.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859715+0000", 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3799999999999998e-07 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859717+0000", 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.832e-06 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859722+0000", 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7490000000000004e-06 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859727+0000", 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.335e-06 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20675 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860383+0000", 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0083817349999999995, 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014394617, 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20675 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860383+0000", 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860383+0000", 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860384+0000", 2024-09-14T07:12:17.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4799999999999999e-07 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860386+0000", 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860392+0000", 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.105e-06 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860397+0000", 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1359999999999996e-06 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20734 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861054+0000", 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0077114849999999997, 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013755574, 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.458 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20734 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861054+0000", 2024-09-14T07:12:17.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861054+0000", 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861054+0000", 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9200000000000002e-07 2024-09-14T07:12:17.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861056+0000", 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8819999999999999e-06 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861062+0000", 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8889999999999999e-06 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861067+0000", 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.028e-06 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20801 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0071571200000000003, 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013227938999999999, 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20801 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7500000000000001e-07 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861610+0000", 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.378e-06 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861614+0000", 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1459999999999998e-06 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861616+0000", 2024-09-14T07:12:17.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.43e-06 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20420 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 98304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857350+0000", 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011414574, 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017528192000000001, 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:17.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20420 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857350+0000", 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857350+0000", 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857351+0000", 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857358+0000", 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8109999999999997e-06 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857364+0000", 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0730000000000001e-06 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857368+0000", 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4009999999999999e-06 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.874751+0000", 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017383215 2024-09-14T07:12:17.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.874834+0000", 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2279000000000003e-05 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20487 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010337234000000001, 2024-09-14T07:12:17.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01651327, 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20487 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858430+0000", 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9860000000000001e-06 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858436+0000", 2024-09-14T07:12:17.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0209999999999996e-06 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858441+0000", 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.403e-06 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20546 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859006+0000", 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0097591139999999993, 2024-09-14T07:12:17.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015982492000000001, 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20546 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859006+0000", 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859006+0000", 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859006+0000", 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9400000000000001e-07 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859008+0000", 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9e-06 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859014+0000", 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9220000000000002e-06 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859019+0000", 2024-09-14T07:12:17.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1760000000000001e-06 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20605 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859733+0000", 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0090317639999999994, 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015284378, 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.479 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20605 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859733+0000", 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859733+0000", 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859734+0000", 2024-09-14T07:12:17.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7500000000000001e-07 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859735+0000", 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.717e-06 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859741+0000", 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-09-14T07:12:17.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859746+0000", 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9790000000000001e-06 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20676 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860404+0000", 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0083613200000000002, 2024-09-14T07:12:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014637271, 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20676 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860404+0000", 2024-09-14T07:12:17.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860404+0000", 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860404+0000", 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860406+0000", 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860411+0000", 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7049999999999996e-06 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860416+0000", 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3170000000000003e-06 2024-09-14T07:12:17.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20742 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861073+0000", 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0076917979999999997, 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013993333, 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.487 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20742 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861073+0000", 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861073+0000", 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861073+0000", 2024-09-14T07:12:17.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6300000000000001e-07 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861075+0000", 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2389999999999999e-06 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861079+0000", 2024-09-14T07:12:17.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0949999999999998e-06 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861082+0000", 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1190000000000001e-06 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20802 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:17.491 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0071456719999999996, 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013472769000000001, 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20802 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.492 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7700000000000003e-07 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861625+0000", 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8169999999999998e-06 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861629+0000", 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8550000000000004e-06 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20421 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.495 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857374+0000", 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011390725000000001, 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017764109, 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20421 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857374+0000", 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857374+0000", 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857375+0000", 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-07 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857377+0000", 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8050000000000001e-06 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857382+0000", 2024-09-14T07:12:17.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857387+0000", 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4680000000000003e-06 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.875137+0000", 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017750473999999999 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20488 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010318531000000001, 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016721099999999999, 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.500 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20488 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858447+0000", 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8599999999999999e-07 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858453+0000", 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3840000000000002e-06 2024-09-14T07:12:17.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858460+0000", 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2960000000000004e-06 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858464+0000", 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6650000000000002e-06 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20547 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859025+0000", 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0097400620000000007, 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01618704, 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.504 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20547 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859025+0000", 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859025+0000", 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859025+0000", 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3200000000000001e-07 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859027+0000", 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7349999999999999e-06 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859033+0000", 2024-09-14T07:12:17.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0430000000000004e-06 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859038+0000", 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5390000000000001e-06 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20606 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859753+0000", 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0090121809999999993, 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015506017, 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20606 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859753+0000", 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859753+0000", 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859753+0000", 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6800000000000001e-07 2024-09-14T07:12:17.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859755+0000", 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.902e-06 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859761+0000", 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9490000000000001e-06 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859766+0000", 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6319999999999999e-06 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20677 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860421+0000", 2024-09-14T07:12:17.511 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0083435829999999999, 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014887154, 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20677 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860421+0000", 2024-09-14T07:12:17.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860421+0000", 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860422+0000", 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860433+0000", 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1362000000000001e-05 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860439+0000", 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2879999999999998e-06 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860444+0000", 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8910000000000003e-06 2024-09-14T07:12:17.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20744 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861085+0000", 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0076799629999999997, 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014257203, 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.515 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20744 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861085+0000", 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861085+0000", 2024-09-14T07:12:17.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861085+0000", 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861086+0000", 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861089+0000", 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861097+0000", 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7559999999999999e-06 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.519 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20803 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.519 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:17.519 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0071302559999999997, 2024-09-14T07:12:17.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013744805000000001, 2024-09-14T07:12:17.519 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20803 2024-09-14T07:12:17.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.03e-07 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861637+0000", 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.703e-06 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861642+0000", 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3990000000000003e-06 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861653+0000", 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0638999999999999e-05 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20422 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 155648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857392+0000", 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011372747000000001, 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018039139999999999, 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20422 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857392+0000", 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857392+0000", 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857393+0000", 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857394+0000", 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.689e-06 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857400+0000", 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5600000000000001e-06 2024-09-14T07:12:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857404+0000", 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.386e-06 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.875403+0000", 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01799889 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20489 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858480+0000", 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010284844, 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016989455000000001, 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20489 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858480+0000", 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858480+0000", 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858481+0000", 2024-09-14T07:12:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8999999999999996e-07 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.215e-06 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858490+0000", 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.686e-06 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858495+0000", 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20548 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859043+0000", 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.009721805, 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016452013000000001, 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20548 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859043+0000", 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859043+0000", 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859044+0000", 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5600000000000001e-07 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859051+0000", 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1509999999999998e-06 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859057+0000", 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.455e-06 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859062+0000", 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5009999999999998e-06 2024-09-14T07:12:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20616 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859772+0000", 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0089932350000000005, 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015746665, 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20616 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859772+0000", 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859772+0000", 2024-09-14T07:12:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859772+0000", 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859774+0000", 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6899999999999999e-06 2024-09-14T07:12:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859780+0000", 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7219999999999996e-06 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859793+0000", 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20678 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860451+0000", 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0083140139999999998, 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015091657, 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20678 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860451+0000", 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860451+0000", 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860451+0000", 2024-09-14T07:12:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2899999999999999e-07 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860453+0000", 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6619999999999999e-06 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860459+0000", 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6250000000000004e-06 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860463+0000", 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3109999999999999e-06 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20746 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861100+0000", 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.007664616, 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014465356, 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20746 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861100+0000", 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861100+0000", 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861101+0000", 2024-09-14T07:12:17.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861102+0000", 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0809999999999999e-06 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861105+0000", 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0920000000000002e-06 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861107+0000", 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20804 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0071053469999999997, 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013952356000000001, 2024-09-14T07:12:17.550 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20804 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6499999999999999e-07 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861662+0000", 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2589999999999999e-06 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861668+0000", 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1070000000000001e-06 2024-09-14T07:12:17.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861673+0000", 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4909999999999999e-06 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20423 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857410+0000", 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011354813, 2024-09-14T07:12:17.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018245994000000001, 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20423 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857410+0000", 2024-09-14T07:12:17.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857410+0000", 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857411+0000", 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.65e-07 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857412+0000", 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8339999999999999e-06 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857418+0000", 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5509999999999999e-06 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857422+0000", 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3749999999999996e-06 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20490 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858501+0000", 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010264031999999999, 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017204048, 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20490 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858501+0000", 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858501+0000", 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858501+0000", 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0800000000000005e-07 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858507+0000", 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0880000000000002e-06 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858513+0000", 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4899999999999997e-06 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858522+0000", 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6000000000000007e-06 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20549 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859068+0000", 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0096972689999999997, 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016682855999999999, 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20549 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859068+0000", 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859068+0000", 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859068+0000", 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.84e-07 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859070+0000", 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.821e-06 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859076+0000", 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2020000000000001e-06 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859086+0000", 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7969999999999995e-06 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20617 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859800+0000", 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0089653110000000001, 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016000749000000002, 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20617 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.566 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859800+0000", 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859800+0000", 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859800+0000", 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7399999999999998e-07 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859808+0000", 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8650000000000001e-06 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859815+0000", 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8889999999999996e-06 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859820+0000", 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0300000000000001e-06 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20679 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860469+0000", 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0082961960000000005, 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015378667, 2024-09-14T07:12:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20679 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860469+0000", 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860469+0000", 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860469+0000", 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860471+0000", 2024-09-14T07:12:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.598e-06 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860477+0000", 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7379999999999999e-06 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860481+0000", 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4070000000000003e-06 2024-09-14T07:12:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20747 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861113+0000", 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0076521189999999998, 2024-09-14T07:12:17.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014783193, 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20747 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.574 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861113+0000", 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861113+0000", 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861113+0000", 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0499999999999999e-07 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861115+0000", 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5859999999999999e-06 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861121+0000", 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9730000000000002e-06 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861125+0000", 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3789999999999999e-06 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20805 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0070857649999999999, 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014267258999999999, 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20805 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:17.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861680+0000", 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861682+0000", 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861687+0000", 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861692+0000", 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4270000000000001e-06 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20424 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.581 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857434+0000", 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011331043000000001, 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018565911000000001, 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20424 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.582 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857434+0000", 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857434+0000", 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857434+0000", 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.51e-07 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857436+0000", 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8789999999999999e-06 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857442+0000", 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1380000000000004e-06 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857447+0000", 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4209999999999997e-06 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.876000+0000", 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018552837999999999 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20491 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858527+0000", 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010238495, 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017523723000000001, 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20491 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858527+0000", 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858527+0000", 2024-09-14T07:12:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858527+0000", 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1800000000000002e-07 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858528+0000", 2024-09-14T07:12:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3519999999999999e-06 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858532+0000", 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4039999999999999e-06 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858534+0000", 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4509999999999999e-06 2024-09-14T07:12:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20550 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859092+0000", 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0096728600000000001, 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017009257, 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20550 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859092+0000", 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859092+0000", 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859093+0000", 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8700000000000001e-07 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859095+0000", 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.058e-06 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859101+0000", 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2419999999999997e-06 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859106+0000", 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.673e-06 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20618 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859827+0000", 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0089379679999999993, 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016321331000000001, 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20618 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859827+0000", 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859827+0000", 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859827+0000", 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4700000000000002e-07 2024-09-14T07:12:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859830+0000", 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0269999999999998e-06 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859835+0000", 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5879999999999997e-06 2024-09-14T07:12:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859839+0000", 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1710000000000004e-06 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20681 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860492+0000", 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0082727640000000002, 2024-09-14T07:12:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015707993999999999, 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20681 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860492+0000", 2024-09-14T07:12:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860492+0000", 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860493+0000", 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4499999999999997e-07 2024-09-14T07:12:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860498+0000", 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5010000000000004e-06 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860510+0000", 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1851000000000001e-05 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860525+0000", 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5413999999999998e-05 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20748 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861132+0000", 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0076333659999999999, 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015114686, 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20748 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861132+0000", 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861132+0000", 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861132+0000", 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7899999999999998e-07 2024-09-14T07:12:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861134+0000", 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.888e-06 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861141+0000", 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2740000000000002e-06 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861146+0000", 2024-09-14T07:12:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4510000000000002e-06 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20806 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0070670580000000002, 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014599097, 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20806 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861700+0000", 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5600000000000001e-06 2024-09-14T07:12:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861705+0000", 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0760000000000002e-06 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861709+0000", 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3499999999999999e-06 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20433 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 270336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.857453+0000", 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.011312065, 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018898671999999998, 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20433 2024-09-14T07:12:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857453+0000", 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857453+0000", 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857453+0000", 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3599999999999999e-07 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857459+0000", 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2800000000000003e-06 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857465+0000", 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0340000000000002e-06 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.857469+0000", 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5879999999999999e-06 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.876254+0000", 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018785133999999998 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.876320+0000", 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5215999999999994e-05 2024-09-14T07:12:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20492 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858537+0000", 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010228065999999999, 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017874681, 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20492 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858537+0000", 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858537+0000", 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858537+0000", 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.05e-07 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858539+0000", 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2979999999999999e-06 2024-09-14T07:12:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858542+0000", 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.988e-06 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858545+0000", 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4420000000000001e-06 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20551 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859129+0000", 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0096357160000000008, 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017329899999999999, 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20551 2024-09-14T07:12:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859129+0000", 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859129+0000", 2024-09-14T07:12:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859130+0000", 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7599999999999997e-07 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859132+0000", 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3140000000000002e-06 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859139+0000", 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.562e-06 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859143+0000", 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6990000000000002e-06 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20619 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859845+0000", 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0089197930000000005, 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016661618, 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20619 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859845+0000", 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859845+0000", 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859846+0000", 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859847+0000", 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859853+0000", 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7950000000000004e-06 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859858+0000", 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4660000000000001e-06 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20687 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860534+0000", 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0082307089999999992, 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016018543999999999, 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20687 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860534+0000", 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860534+0000", 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860535+0000", 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.41e-07 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860536+0000", 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4920000000000001e-06 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860540+0000", 2024-09-14T07:12:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5130000000000001e-06 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860542+0000", 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7949999999999999e-06 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20749 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861153+0000", 2024-09-14T07:12:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0076122969999999996, 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015446489000000001, 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20749 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861153+0000", 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861153+0000", 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861153+0000", 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3000000000000001e-07 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861164+0000", 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0879999999999999e-05 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861171+0000", 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0940000000000002e-06 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861176+0000", 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8350000000000003e-06 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20807 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0070504230000000001, 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014932997999999999, 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20807 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861717+0000", 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861722+0000", 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861733+0000", 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0898e-05 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20493 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858548+0000", 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010216911, 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01813159, 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20493 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858548+0000", 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858548+0000", 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858548+0000", 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858549+0000", 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9800000000000002e-07 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858552+0000", 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8459999999999999e-06 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858554+0000", 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.424e-06 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20552 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859154+0000", 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0096112130000000004, 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017563005999999999, 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20552 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859154+0000", 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859154+0000", 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859154+0000", 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2099999999999996e-07 2024-09-14T07:12:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859157+0000", 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1150000000000001e-06 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859163+0000", 2024-09-14T07:12:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1430000000000003e-06 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859167+0000", 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20620 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859863+0000", 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0089018570000000009, 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016892279999999999, 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20620 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859863+0000", 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859863+0000", 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859863+0000", 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859865+0000", 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.125e-06 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859868+0000", 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.185e-06 2024-09-14T07:12:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859870+0000", 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20689 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860546+0000", 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.008219189, 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016254309000000002, 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20689 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860546+0000", 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860546+0000", 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860546+0000", 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.05e-07 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860547+0000", 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4e-07 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860552+0000", 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7979999999999996e-06 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860562+0000", 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20750 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861185+0000", 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0075799889999999997, 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015656903999999999, 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20750 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861185+0000", 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861185+0000", 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861186+0000", 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7899999999999999e-07 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861188+0000", 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2309999999999999e-06 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861194+0000", 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1519999999999997e-06 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861198+0000", 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5770000000000004e-06 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20817 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0070273050000000002, 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015151179000000001, 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20817 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9700000000000003e-07 2024-09-14T07:12:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861745+0000", 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1520000000000003e-06 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861749+0000", 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6030000000000001e-06 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861751+0000", 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4509999999999999e-06 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20494 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010207160999999999, 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018380725000000001, 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20494 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.16e-07 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858559+0000", 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.71e-07 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858562+0000", 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9790000000000002e-06 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858564+0000", 2024-09-14T07:12:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.57e-06 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20562 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859174+0000", 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0095914009999999994, 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017816117999999999, 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20562 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859174+0000", 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859174+0000", 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859174+0000", 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.34e-07 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859176+0000", 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8640000000000001e-06 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859183+0000", 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8730000000000001e-06 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859195+0000", 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1919000000000001e-05 2024-09-14T07:12:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20621 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859873+0000", 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0088919840000000003, 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017162726, 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20621 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859873+0000", 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859873+0000", 2024-09-14T07:12:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859873+0000", 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1e-07 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859874+0000", 2024-09-14T07:12:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0100000000000003e-07 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859877+0000", 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9359999999999999e-06 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859886+0000", 2024-09-14T07:12:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9849999999999995e-06 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20691 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860569+0000", 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081958229999999997, 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016516731, 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20691 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860569+0000", 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860569+0000", 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860570+0000", 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.03e-07 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860572+0000", 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0710000000000002e-06 2024-09-14T07:12:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860578+0000", 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.066e-06 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860582+0000", 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3529999999999997e-06 2024-09-14T07:12:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20751 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861205+0000", 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0075600290000000002, 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015926704999999999, 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20751 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861205+0000", 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861205+0000", 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861206+0000", 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2399999999999998e-07 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861207+0000", 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8279999999999999e-06 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861213+0000", 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9020000000000004e-06 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861218+0000", 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3100000000000002e-06 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20818 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0070105269999999999, 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0154264, 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20818 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861755+0000", 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861756+0000", 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861758+0000", 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861761+0000", 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2740000000000002e-06 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20495 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.010197753, 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018660428, 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20495 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0699999999999999e-07 2024-09-14T07:12:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858568+0000", 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2500000000000004e-07 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.858574+0000", 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4040000000000002e-06 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20563 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859202+0000", 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0095630320000000008, 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018072362000000002, 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20563 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859202+0000", 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859202+0000", 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859202+0000", 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859205+0000", 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.131e-06 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859211+0000", 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9989999999999997e-06 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859215+0000", 2024-09-14T07:12:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3549999999999998e-06 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20622 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.859890+0000", 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0088750849999999996, 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017432818999999999, 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20622 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859890+0000", 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859890+0000", 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859890+0000", 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4000000000000002e-07 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859892+0000", 2024-09-14T07:12:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7889999999999999e-06 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859898+0000", 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6540000000000004e-06 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.859903+0000", 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3700000000000003e-06 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20693 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.860589+0000", 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081762139999999994, 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016779783999999999, 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20693 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860589+0000", 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860589+0000", 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860589+0000", 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7700000000000001e-07 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860590+0000", 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.311e-06 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860594+0000", 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.631e-06 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.860597+0000", 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5569999999999998e-06 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20752 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861224+0000", 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0075411200000000001, 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016193372000000001, 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20752 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861224+0000", 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861224+0000", 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861224+0000", 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861226+0000", 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7659999999999999e-06 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861232+0000", 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9290000000000003e-06 2024-09-14T07:12:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861236+0000", 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1289999999999998e-06 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20820 3.17 3.28a07537 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0070017070000000002, 2024-09-14T07:12:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015699388000000002, 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20820 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861764+0000", 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861777+0000", 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3089e-05 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861784+0000", 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861789+0000", 2024-09-14T07:12:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 202 2024-09-14T07:12:17.711 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:17.712 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:17.711+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:17.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:17.713 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-14T07:12:17.783 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:12:17.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:17.814 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:17.813+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:17.902 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:17.902 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:17.902 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:17.902 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:17.903 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:17.915 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:17.914+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:17.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:18.016 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:18.015+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:18.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:18.063 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:18.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:18.103 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:18.117 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:18.116+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:18.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:18.149 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:18.149 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:18.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:18.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:18.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:18.197 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:18.217 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:18.217+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:18.230 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:18.230 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:18.251 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:18.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:18.256 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:18.257 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:18.308 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:18.308 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:18.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:18.323 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:18.322+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:18.419 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:18.418+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:18.426 INFO:teuthology.orchestra.run.smithi071.stdout:1535 trunc from 0xe2bbe6e to 0x3a064a7 2024-09-14T07:12:18.441 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:18.442 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:18.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:18.474 INFO:teuthology.orchestra.run.smithi071.stdout:1536 punch from 0x37a2e67 to 0x37aa2bd, (0x7456 bytes) 2024-09-14T07:12:18.474 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:18.474 INFO:teuthology.orchestra.run.smithi071.stdout:1538 read 0x19b3f28 thru 0x19bec04 (0xacdd bytes) 2024-09-14T07:12:18.491 INFO:teuthology.orchestra.run.smithi071.stdout:1539 write 0xdaae94c thru 0xdab2267 (0x391c bytes) 2024-09-14T07:12:18.493 INFO:teuthology.orchestra.run.smithi071.stdout:1540 punch from 0x772fdbe to 0x773986f, (0x9ab1 bytes) 2024-09-14T07:12:18.497 INFO:teuthology.orchestra.run.smithi071.stdout:1541 trunc from 0xdab2268 to 0x9ff445f 2024-09-14T07:12:18.506 INFO:teuthology.orchestra.run.smithi071.stdout:1542 writesame 0x6bfc3b2 thru 0x6c06906 data_size 0x5(0xa555 bytes) 2024-09-14T07:12:18.518 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:18.518+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:18.521 INFO:teuthology.orchestra.run.smithi071.stdout:1543 writesame 0xdb4b28e thru 0xdb509d7 data_size 0x1(0x574a bytes) 2024-09-14T07:12:18.522 INFO:teuthology.orchestra.run.smithi071.stdout:1544 read 0x51a7241 thru 0x51a7fcd (0xd8d bytes) 2024-09-14T07:12:18.522 INFO:teuthology.orchestra.run.smithi071.stdout:1545 write 0x9aa5f81 thru 0x9aac037 (0x60b7 bytes) 2024-09-14T07:12:18.536 INFO:teuthology.orchestra.run.smithi071.stdout:1547 trunc from 0xdb509d8 to 0x34db824 2024-09-14T07:12:18.549 INFO:teuthology.orchestra.run.smithi071.stdout:1548 writesame 0xa487a1 thru 0xa4b28c data_size 0x43(0x2aec bytes) 2024-09-14T07:12:18.550 INFO:teuthology.orchestra.run.smithi071.stdout:1549 writesame 0x28cd88 thru 0x291762 data_size 0x7(0x49db bytes) 2024-09-14T07:12:18.552 INFO:teuthology.orchestra.run.smithi071.stdout:1551 read 0x172477e thru 0x172c74d (0x7fd0 bytes) 2024-09-14T07:12:18.553 INFO:teuthology.orchestra.run.smithi071.stdout:1552 punch from 0x20c328b to 0x20c747f, (0x41f4 bytes) 2024-09-14T07:12:18.556 INFO:teuthology.orchestra.run.smithi071.stdout:1553 trunc from 0x34db824 to 0x5d7a1d7 2024-09-14T07:12:18.561 INFO:teuthology.orchestra.run.smithi071.stdout:1555 write 0x1c78006 thru 0x1c87e74 (0xfe6f bytes) 2024-09-14T07:12:18.562 INFO:teuthology.orchestra.run.smithi071.stdout:1556 punch from 0x22c5b04 to 0x22d2809, (0xcd05 bytes) 2024-09-14T07:12:18.573 INFO:teuthology.orchestra.run.smithi071.stdout:1557 write 0xa45908e thru 0xa45f047 (0x5fba bytes) 2024-09-14T07:12:18.574 INFO:teuthology.orchestra.run.smithi071.stdout:1558 punch from 0x6f112a7 to 0x6f13161, (0x1eba bytes) 2024-09-14T07:12:18.574 INFO:teuthology.orchestra.run.smithi071.stdout:1559 read 0x209c837 thru 0x209e0a7 (0x1871 bytes) 2024-09-14T07:12:18.582 INFO:teuthology.orchestra.run.smithi071.stdout:1560 writesame 0xbeac930 thru 0xbeaf713 data_size 0x2c(0x2de4 bytes) 2024-09-14T07:12:18.583 INFO:teuthology.orchestra.run.smithi071.stdout:1561 read 0x284e3e6 thru 0x28578c1 (0x94dc bytes) 2024-09-14T07:12:18.585 INFO:teuthology.orchestra.run.smithi071.stdout:1562 trunc from 0xbeaf714 to 0xaf22e6a 2024-09-14T07:12:18.590 INFO:teuthology.orchestra.run.smithi071.stdout:1563 read 0xf96db6 thru 0xf9c934 (0x5b7f bytes) 2024-09-14T07:12:18.591 INFO:teuthology.orchestra.run.smithi071.stdout:1564 write 0x6f0ad3b thru 0x6f0ca2c (0x1cf2 bytes) 2024-09-14T07:12:18.593 INFO:teuthology.orchestra.run.smithi071.stdout:1565 trunc from 0xaf22e6a to 0xb6205c1 2024-09-14T07:12:18.595 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:18.596 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:18.598 INFO:teuthology.orchestra.run.smithi071.stdout:1566 read 0x61eb87f thru 0x61f7e66 (0xc5e8 bytes) 2024-09-14T07:12:18.598 INFO:teuthology.orchestra.run.smithi071.stdout:1567 write 0x8eb14f9 thru 0x8eb326a (0x1d72 bytes) 2024-09-14T07:12:18.600 INFO:teuthology.orchestra.run.smithi071.stdout:1568 punch from 0x9edb1d9 to 0x9ee7b74, (0xc99b bytes) 2024-09-14T07:12:18.600 INFO:teuthology.orchestra.run.smithi071.stdout:1569 read 0x640eb06 thru 0x6413b65 (0x5060 bytes) 2024-09-14T07:12:18.600 INFO:teuthology.orchestra.run.smithi071.stdout:1570 writesame 0xa59645d thru 0xa598c95 data_size 0x1(0x2839 bytes) 2024-09-14T07:12:18.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:18.612 INFO:teuthology.orchestra.run.smithi071.stdout:1571 write 0xe774a75 thru 0xe780b3d (0xc0c9 bytes) 2024-09-14T07:12:18.614 INFO:teuthology.orchestra.run.smithi071.stdout:1572 read 0xca29119 thru 0xca2ca2d (0x3915 bytes) 2024-09-14T07:12:18.614 INFO:teuthology.orchestra.run.smithi071.stdout:1574 punch from 0x67c4639 to 0x67c7fa4, (0x396b bytes) 2024-09-14T07:12:18.617 INFO:teuthology.orchestra.run.smithi071.stdout:1576 trunc from 0xe780b3e to 0xb7eed7c 2024-09-14T07:12:18.619 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:18.619+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:18.625 INFO:teuthology.orchestra.run.smithi071.stdout:1577 clone 16 order 19 su 8192 sc 7 2024-09-14T07:12:18.716 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:18.716 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:18.720 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:18.719+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:18.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:18.821 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:18.820+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:18.847 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone15 from 0xb7eed7c (overlap 0x34db824) to 0x1fb6e7c 2024-09-14T07:12:18.880 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:18.880 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:18.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:18.922 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-14T07:12:18.922 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:18.921+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:19.023 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:19.023+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:19.052 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.052 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:19.124 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:19.123+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:19.168 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.168 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:19.189 INFO:teuthology.orchestra.run.smithi071.stdout:1579 read 0x4aecdb1 thru 0x4af0ac3 (0x3d13 bytes) 2024-09-14T07:12:19.191 INFO:teuthology.orchestra.run.smithi071.stdout:1580 write 0x775e233 thru 0x776b594 (0xd362 bytes) 2024-09-14T07:12:19.233 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:19.232+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:19.249 INFO:teuthology.orchestra.run.smithi071.stdout:1581 write 0x294ad8 thru 0x2a0ca6 (0xc1cf bytes) 2024-09-14T07:12:19.312 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.312 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:19.363 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:19.362+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:1582 trunc from 0xb7eed7c to 0x65f7e34 2024-09-14T07:12:19.426 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:19.425+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:19.474 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.474 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.475 INFO:teuthology.orchestra.run.smithi071.stdout:1583 write 0x3c7d401 thru 0x3c8d2e0 (0xfee0 bytes) 2024-09-14T07:12:19.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:19.531 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:19.530+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:19.534 INFO:teuthology.orchestra.run.smithi071.stdout:1584 write 0x6418603 thru 0x641bda6 (0x37a4 bytes) 2024-09-14T07:12:19.569 INFO:teuthology.orchestra.run.smithi071.stdout:1585 write 0xee256bb thru 0xee2724f (0x1b95 bytes) 2024-09-14T07:12:19.587 INFO:teuthology.orchestra.run.smithi071.stdout:1586 trunc from 0xee27250 to 0x2a1cc6e 2024-09-14T07:12:19.601 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.601 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:19.628 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:19.627+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:19.668 INFO:teuthology.orchestra.run.smithi071.stdout:1587 writesame 0x67c1b00 thru 0x67c3ce2 data_size 0x5(0x21e3 bytes) 2024-09-14T07:12:19.668 INFO:teuthology.orchestra.run.smithi071.stdout:1588 punch from 0x649eb8 to 0x6575b5, (0xd6fd bytes) 2024-09-14T07:12:19.668 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:19.669 INFO:teuthology.orchestra.run.smithi071.stdout:1590 read 0x59ea5c0 thru 0x59f7384 (0xcdc5 bytes) 2024-09-14T07:12:19.669 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:19.669 INFO:teuthology.orchestra.run.smithi071.stdout:1592 write 0xad57a2 thru 0xadf15e (0x99bd bytes) 2024-09-14T07:12:19.729 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:19.728+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:19.734 INFO:teuthology.orchestra.run.smithi071.stdout:1595 read 0x38a4ba9 thru 0x38a61b8 (0x1610 bytes) 2024-09-14T07:12:19.742 INFO:teuthology.orchestra.run.smithi071.stdout:1596 trunc from 0x67c3ce3 to 0xcc4e347 2024-09-14T07:12:19.748 INFO:teuthology.orchestra.run.smithi071.stdout:1597 punch from 0xc41bdf1 to 0xc420834, (0x4a43 bytes) 2024-09-14T07:12:19.748 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:19.749 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:19.749 INFO:teuthology.orchestra.run.smithi071.stdout:1600 read 0x904e48f thru 0x90501f6 (0x1d68 bytes) 2024-09-14T07:12:19.749 INFO:teuthology.orchestra.run.smithi071.stdout:1601 writesame 0xc6526cf thru 0xc65ea6c data_size 0xe(0xc39e bytes) 2024-09-14T07:12:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.758 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:19.773 INFO:teuthology.orchestra.run.smithi071.stdout:1603 trunc from 0xcc4e347 to 0x15f91ec 2024-09-14T07:12:19.776 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:19.776 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:19.776 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T07:12:19.776 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.375026 2024-09-14T07:12:19.776 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 0.3750256870362748 2024-09-14T07:12:19.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:12:19.838 INFO:teuthology.orchestra.run.smithi071.stdout:1604 trunc from 0x15f91ec to 0x445c05b 2024-09-14T07:12:19.839 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:19.838+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:19.848 INFO:teuthology.orchestra.run.smithi071.stdout:1605 trunc from 0x445c05b to 0x11e5f3f 2024-09-14T07:12:19.930 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:19.930+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:19.935 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:19.935 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:19.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:19.961 INFO:teuthology.orchestra.run.smithi071.stdout:1606 write 0x9fd12eb thru 0x9fdef52 (0xdc68 bytes) 2024-09-14T07:12:19.978 INFO:teuthology.orchestra.run.smithi071.stdout:1607 trunc from 0x9fdef53 to 0x6737213 2024-09-14T07:12:19.986 INFO:teuthology.orchestra.run.smithi071.stdout:1608 read 0x2db4622 thru 0x2dc353e (0xef1d bytes) 2024-09-14T07:12:19.986 INFO:teuthology.orchestra.run.smithi071.stdout:1610 read 0x3a3c2fd thru 0x3a45472 (0x9176 bytes) 2024-09-14T07:12:19.996 INFO:teuthology.orchestra.run.smithi071.stdout:1611 trunc from 0x6737213 to 0xed35cc2 2024-09-14T07:12:20.003 INFO:teuthology.orchestra.run.smithi071.stdout:1612 write 0x1bf5176 thru 0x1bfebab (0x9a36 bytes) 2024-09-14T07:12:20.015 INFO:teuthology.orchestra.run.smithi071.stdout:1613 punch from 0xdc63d6a to 0xdc645b9, (0x84f bytes) 2024-09-14T07:12:20.015 INFO:teuthology.orchestra.run.smithi071.stdout:1614 writesame 0x59378a8 thru 0x593b828 data_size 0x1(0x3f81 bytes) 2024-09-14T07:12:20.029 INFO:teuthology.orchestra.run.smithi071.stdout:1616 trunc from 0xed35cc2 to 0x8ca058e 2024-09-14T07:12:20.031 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:20.031+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:20.043 INFO:teuthology.orchestra.run.smithi071.stdout:1617 writesame 0xcd22545 thru 0xcd2d139 data_size 0x1(0xabf5 bytes) 2024-09-14T07:12:20.044 INFO:teuthology.orchestra.run.smithi071.stdout:1618 write 0x3ba0502 thru 0x3ba0b8d (0x68c bytes) 2024-09-14T07:12:20.046 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.046 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.048 INFO:teuthology.orchestra.run.smithi071.stdout:1623 trunc from 0xcd2d13a to 0xea1bd4e 2024-09-14T07:12:20.051 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:20.051 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:20.052 INFO:teuthology.orchestra.run.smithi071.stdout:1624 write 0xac78a8e thru 0xac7c88c (0x3dff bytes) 2024-09-14T07:12:20.056 INFO:teuthology.orchestra.run.smithi071.stdout:1625 write 0xdb17144 thru 0xdb1c14a (0x5007 bytes) 2024-09-14T07:12:20.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:20.068 INFO:teuthology.orchestra.run.smithi071.stdout:1628 trunc from 0xea1bd4e to 0x8dc2543 2024-09-14T07:12:20.077 INFO:teuthology.orchestra.run.smithi071.stdout:1629 writesame 0x3827b8b thru 0x383386e data_size 0x4d(0xbce4 bytes) 2024-09-14T07:12:20.090 INFO:teuthology.orchestra.run.smithi071.stdout:1630 trunc from 0x8dc2543 to 0x5b67a8b 2024-09-14T07:12:20.095 INFO:teuthology.orchestra.run.smithi071.stdout:1631 write 0x417c36c thru 0x4185a34 (0x96c9 bytes) 2024-09-14T07:12:20.104 INFO:teuthology.orchestra.run.smithi071.stdout:1632 read 0x1912294 thru 0x1916663 (0x43d0 bytes) 2024-09-14T07:12:20.105 INFO:teuthology.orchestra.run.smithi071.stdout:1633 write 0x1403c4f thru 0x141237e (0xe730 bytes) 2024-09-14T07:12:20.116 INFO:teuthology.orchestra.run.smithi071.stdout:1635 writesame 0x904a447 thru 0x905a2f8 data_size 0x3(0xfeb2 bytes) 2024-09-14T07:12:20.116 INFO:teuthology.orchestra.run.smithi071.stdout:1636 read 0x293e703 thru 0x294375c (0x505a bytes) 2024-09-14T07:12:20.116 INFO:teuthology.orchestra.run.smithi071.stdout:1638 punch from 0x38a71eb to 0x38b54d8, (0xe2ed bytes) 2024-09-14T07:12:20.117 INFO:teuthology.orchestra.run.smithi071.stdout:1639 punch from 0x5b06537 to 0x5b1152d, (0xaff6 bytes) 2024-09-14T07:12:20.117 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.117 INFO:teuthology.orchestra.run.smithi071.stdout:1642 write 0x668933a thru 0x668c9ea (0x36b1 bytes) 2024-09-14T07:12:20.124 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.124 INFO:teuthology.orchestra.run.smithi071.stdout:1644 punch from 0x8284c89 to 0x8285495, (0x80c bytes) 2024-09-14T07:12:20.124 INFO:teuthology.orchestra.run.smithi071.stdout:1645 write 0x7f5fa91 thru 0x7f68f3c (0x94ac bytes) 2024-09-14T07:12:20.132 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:20.131+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:20.136 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.136 INFO:teuthology.orchestra.run.smithi071.stdout:1647 read 0x6f1f91a thru 0x6f22f7b (0x3662 bytes) 2024-09-14T07:12:20.138 INFO:teuthology.orchestra.run.smithi071.stdout:1648 trunc from 0x905a2f9 to 0xb869a93 2024-09-14T07:12:20.145 INFO:teuthology.orchestra.run.smithi071.stdout:1652 punch from 0xa847b5f to 0xa850456, (0x88f7 bytes) 2024-09-14T07:12:20.145 INFO:teuthology.orchestra.run.smithi071.stdout:1653 read 0x2154ec0 thru 0x215ea65 (0x9ba6 bytes) 2024-09-14T07:12:20.145 INFO:teuthology.orchestra.run.smithi071.stdout:1654 punch from 0x161c908 to 0x161eeba, (0x25b2 bytes) 2024-09-14T07:12:20.145 INFO:teuthology.orchestra.run.smithi071.stdout:1655 write 0x430b24b thru 0x43121ac (0x6f62 bytes) 2024-09-14T07:12:20.156 INFO:teuthology.orchestra.run.smithi071.stdout:1656 write 0xc11ee17 thru 0xc122bfb (0x3de5 bytes) 2024-09-14T07:12:20.164 INFO:teuthology.orchestra.run.smithi071.stdout:1657 write 0xc5c352a thru 0xc5c59fb (0x24d2 bytes) 2024-09-14T07:12:20.168 INFO:teuthology.orchestra.run.smithi071.stdout:1658 trunc from 0xc5c59fc to 0xcd4dd72 2024-09-14T07:12:20.169 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:20.169 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:20.173 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.173 INFO:teuthology.orchestra.run.smithi071.stdout:1662 read 0xb0b8044 thru 0xb0b832b (0x2e8 bytes) 2024-09-14T07:12:20.173 INFO:teuthology.orchestra.run.smithi071.stdout:1663 read 0x7d5007b thru 0x7d5c9cb (0xc951 bytes) 2024-09-14T07:12:20.173 INFO:teuthology.orchestra.run.smithi071.stdout:1665 write 0x9518212 thru 0x951bedc (0x3ccb bytes) 2024-09-14T07:12:20.177 INFO:teuthology.orchestra.run.smithi071.stdout:1666 punch from 0x4bcf80f to 0x4bdc0a0, (0xc891 bytes) 2024-09-14T07:12:20.177 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.177 INFO:teuthology.orchestra.run.smithi071.stdout:1668 punch from 0x4d78af7 to 0x4d81d6b, (0x9274 bytes) 2024-09-14T07:12:20.177 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.177 INFO:teuthology.orchestra.run.smithi071.stdout:1670 writesame 0xb877e09 thru 0xb87e2b5 data_size 0x47(0x64ad bytes) 2024-09-14T07:12:20.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:20.187 INFO:teuthology.orchestra.run.smithi071.stdout:1671 read 0x8c48615 thru 0x8c57077 (0xea63 bytes) 2024-09-14T07:12:20.187 INFO:teuthology.orchestra.run.smithi071.stdout:1672 writesame 0x884857c thru 0x884cbe3 data_size 0xc(0x4668 bytes) 2024-09-14T07:12:20.194 INFO:teuthology.orchestra.run.smithi071.stdout:1673 read 0xc2e2913 thru 0xc2efaf0 (0xd1de bytes) 2024-09-14T07:12:20.197 INFO:teuthology.orchestra.run.smithi071.stdout:1675 trunc from 0xcd4dd72 to 0xb101c6d 2024-09-14T07:12:20.207 INFO:teuthology.orchestra.run.smithi071.stdout:1676 writesame 0x4bb77b thru 0x4bbc67 data_size 0x1(0x4ed bytes) 2024-09-14T07:12:20.224 INFO:teuthology.orchestra.run.smithi071.stdout:1677 write 0x8ce47f3 thru 0x8cea6a5 (0x5eb3 bytes) 2024-09-14T07:12:20.229 INFO:teuthology.orchestra.run.smithi071.stdout:1678 write 0xe774c9 thru 0xe7a3dd (0x2f15 bytes) 2024-09-14T07:12:20.233 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:20.232+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:20.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:20.261 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:20.261 INFO:teuthology.orchestra.run.smithi071.stdout:1682 trunc from 0xb101c6d to 0xad7c498 2024-09-14T07:12:20.265 INFO:teuthology.orchestra.run.smithi071.stdout:1683 clone 17 order 25 su 8388608 sc 8 2024-09-14T07:12:20.322 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:20.322 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:20.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:20.333 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:20.332+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:20.379 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:20.379 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:20.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:20.396 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:20.411 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:20.411 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:20.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:20.427 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:20.433 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:20.433 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:20.434 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:20.433+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:20.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:20.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:20.460 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:20.460 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:20.476 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:20.476 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:20.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:20.480 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:20.535 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:20.534+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:20.544 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:20.544 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:20.544 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:20.544 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:20.544 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:20.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:20.636 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:20.635+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:20.656 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:20.656 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.520142153000002, 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:20.657 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:20.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:20.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:20.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.964825631, 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:20.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:20.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:20.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.744552734, 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:20.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:12:20.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7445310429999998, 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:12:20.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:12:20.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7445111400000002, 2024-09-14T07:12:20.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7444896459999999, 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:12:20.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:12:20.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7444713250000001, 2024-09-14T07:12:20.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:12:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:12:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7444449820000001, 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:12:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:12:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7444245170000001, 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:12:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7444026620000002, 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7443840269999997, 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:12:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.744357886, 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:12:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.744330368, 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:12:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7443128890000001, 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:12:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.744300773, 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:12:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:12:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7388587549999999, 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7388394310000002, 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:12:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:12:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7388105810000001, 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:12:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:12:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.738770057, 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:12:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:12:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.7387480320000002, 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:12:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:12:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:20.750 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:20.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:20.752 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:20.751+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:12:20.790 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.3 primary-affinity to 0.375026 (8245772) 2024-09-14T07:12:20.852 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:20.852+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:20.855 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone16 from 0xad7c498 (overlap 0x11e5f3f) to 0xabd2bf 2024-09-14T07:12:20.875 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3.f5e12158 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.019057109999999999, 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019074160999999999, 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for peered", 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:12:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3.e7905e4b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.019021498000000001, 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01907969, 2024-09-14T07:12:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for peered", 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:12:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3.a69dbc0b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.015980896000000001, 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016070316000000001, 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for peered", 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:12:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 3 2024-09-14T07:12:20.889 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:20.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:20.954 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:20.954+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:21.033 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:21.034 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:21.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:21.054 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:21.054+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:21.146 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20784 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 638976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861477+0000", 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2836312420000002, 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072448988000000006, 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.147 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20784 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861477+0000", 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861477+0000", 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861478+0000", 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861479+0000", 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4099999999999997e-07 2024-09-14T07:12:21.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861481+0000", 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9340000000000002e-06 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861484+0000", 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3640000000000002e-06 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.933774+0000", 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072290322000000004 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.933819+0000", 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4789000000000001e-05 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.933926+0000", 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010753 2024-09-14T07:12:21.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20785 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 978944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2836220919999999, 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073237573, 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20785 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861487+0000", 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861488+0000", 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5600000000000004e-07 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861491+0000", 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8550000000000002e-06 2024-09-14T07:12:21.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861493+0000", 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3690000000000001e-06 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.933973+0000", 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.072480157000000003 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.934396+0000", 2024-09-14T07:12:21.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042250399999999998 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.934724+0000", 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032862400000000002 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20786 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 696320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861496+0000", 2024-09-14T07:12:21.156 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2836122589999999, 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073491876999999997, 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20786 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861496+0000", 2024-09-14T07:12:21.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861496+0000", 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861497+0000", 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1899999999999998e-07 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861498+0000", 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.325e-06 2024-09-14T07:12:21.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861505+0000", 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0029999999999997e-06 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861510+0000", 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4020000000000004e-06 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.934758+0000", 2024-09-14T07:12:21.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073248510000000003 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.934843+0000", 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600999999999999e-05 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.934988+0000", 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014571699999999999 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20787 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1036288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2835928489999997, 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073802193000000002, 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20787 2024-09-14T07:12:21.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:21.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861518+0000", 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861524+0000", 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861529+0000", 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3719999999999998e-06 2024-09-14T07:12:21.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935021+0000", 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073492476000000001 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935106+0000", 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5463999999999994e-05 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935318+0000", 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211623 2024-09-14T07:12:21.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20788 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2835752899999999, 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07400669, 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20788 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861534+0000", 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861540+0000", 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9309999999999996e-06 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861543+0000", 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861546+0000", 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935348+0000", 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073801781999999996 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935423+0000", 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5080000000000006e-05 2024-09-14T07:12:21.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935540+0000", 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011749899999999999 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20798 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 528384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2835595529999999, 2024-09-14T07:12:21.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231058000000003, 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20798 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861550+0000", 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.017e-06 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861553+0000", 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.909e-06 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861559+0000", 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935582+0000", 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074022663000000002 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935663+0000", 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1865000000000003e-05 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935780+0000", 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011686 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20799 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2835431450000003, 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074466447000000005, 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20799 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.174 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:21.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861567+0000", 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861572+0000", 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9609999999999996e-06 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861576+0000", 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:12:21.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935808+0000", 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231973000000007 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935878+0000", 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0143999999999998e-05 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936032+0000", 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153774 2024-09-14T07:12:21.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20800 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2835265700000003, 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074574472000000003, 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20800 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861584+0000", 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7940000000000001e-06 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861596+0000", 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2092e-05 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861602+0000", 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936049+0000", 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074446734000000001 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936091+0000", 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1947999999999999e-05 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936157+0000", 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5569999999999997e-05 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20801 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 868352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:21.182 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2835008300000004, 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07473929, 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20801 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.183 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7500000000000001e-07 2024-09-14T07:12:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861610+0000", 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.378e-06 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861614+0000", 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1459999999999998e-06 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861616+0000", 2024-09-14T07:12:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.43e-06 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936172+0000", 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074555621000000002 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936210+0000", 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8260000000000003e-05 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936347+0000", 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013718000000000001 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20802 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 643072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.283489382, 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075010695000000002, 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20802 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7700000000000003e-07 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861625+0000", 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8169999999999998e-06 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861629+0000", 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8550000000000004e-06 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936409+0000", 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074779656 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936501+0000", 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1933000000000002e-05 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936630+0000", 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129336 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20803 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 925696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2834739659999999, 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075273382, 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20803 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.03e-07 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861637+0000", 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.703e-06 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861642+0000", 2024-09-14T07:12:21.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3990000000000003e-06 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861653+0000", 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0638999999999999e-05 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936659+0000", 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075006286000000005 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936700+0000", 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0649000000000003e-05 2024-09-14T07:12:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936908+0000", 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020830299999999999 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20804 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 700416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2834490570000003, 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505252999999994, 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20804 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:21.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6499999999999999e-07 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861662+0000", 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2589999999999999e-06 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861668+0000", 2024-09-14T07:12:21.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1070000000000001e-06 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861673+0000", 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4909999999999999e-06 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936955+0000", 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075281854999999995 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937041+0000", 2024-09-14T07:12:21.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5783000000000002e-05 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937165+0000", 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012429300000000001 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20805 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 983040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2834294750000002, 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075862623000000004, 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20805 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:21.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861680+0000", 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861682+0000", 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861687+0000", 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861692+0000", 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4270000000000001e-06 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937197+0000", 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505371000000002 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937280+0000", 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2848000000000004e-05 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937542+0000", 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000261826 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20806 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 757760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2834107679999995, 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076006066999999997, 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.204 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20806 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:21.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861700+0000", 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5600000000000001e-06 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861705+0000", 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0760000000000002e-06 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861709+0000", 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3499999999999999e-06 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937567+0000", 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075857407000000002 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937627+0000", 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0457000000000001e-05 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937704+0000", 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6872000000000005e-05 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20807 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2833941329999998, 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076214191000000001, 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20807 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861717+0000", 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861722+0000", 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-09-14T07:12:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861733+0000", 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0898e-05 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937724+0000", 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075991264000000003 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937770+0000", 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5809000000000001e-05 2024-09-14T07:12:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937929+0000", 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158651 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20817 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2833710150000002, 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076617540999999997, 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20817 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9700000000000003e-07 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861745+0000", 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1520000000000003e-06 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861749+0000", 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6030000000000001e-06 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861751+0000", 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4509999999999999e-06 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937964+0000", 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076212703000000007 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938051+0000", 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6681999999999994e-05 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938355+0000", 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000304653 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20818 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2833542370000002, 2024-09-14T07:12:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076901419999999998, 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20818 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861755+0000", 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861756+0000", 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861758+0000", 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861761+0000", 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2740000000000002e-06 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938385+0000", 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076624135999999995 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938464+0000", 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9232000000000003e-05 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938656+0000", 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019190400000000001 2024-09-14T07:12:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20820 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 929792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2833454169999996, 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077243888999999996, 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20820 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861764+0000", 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861777+0000", 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3089e-05 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861784+0000", 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861789+0000", 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938674+0000", 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076885242000000006 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938740+0000", 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5790999999999994e-05 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939007+0000", 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026745499999999999 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20821 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 987136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2833113560000005, 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077536638000000005, 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20821 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861798+0000", 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861800+0000", 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.956e-06 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861807+0000", 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250000000000002e-06 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861812+0000", 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5469999999999998e-06 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939032+0000", 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077220252000000003 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939146+0000", 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011423 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939334+0000", 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018782799999999999 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20823 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1044480~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2832903959999999, 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077848745999999996, 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20823 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861819+0000", 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.77e-07 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861820+0000", 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.792e-06 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861827+0000", 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8979999999999999e-06 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861832+0000", 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3630000000000004e-06 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939383+0000", 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077551163000000006 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939475+0000", 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2471000000000003e-05 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939667+0000", 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019168200000000001 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.236 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:21.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:21.238 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:21.236+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:21.338 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:21.337+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:21.381 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:21.381 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:21.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:21.439 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:21.438+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:21.492 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:21.493 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:21.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:21.542 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:21.541+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:21.641 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:21.640+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:26445 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1236992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.169824+0000", 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4735772899999997, 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0521451, 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 26445 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.169824+0000", 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.169824+0000", 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.169825+0000", 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2500000000000001e-07 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.169826+0000", 2024-09-14T07:12:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9139999999999998e-06 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.169833+0000", 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1759999999999998e-06 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.169837+0000", 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8069999999999999e-06 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.219760+0000", 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.049923043 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.219838+0000", 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7337999999999997e-05 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.221969+0000", 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021313970000000002 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:26527 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1990656~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.177320+0000", 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4660812539999997, 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050842817999999998, 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 26527 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.177320+0000", 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.177320+0000", 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.178549+0000", 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001229071 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.178554+0000", 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1989999999999997e-06 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.178568+0000", 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3584000000000001e-05 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.178575+0000", 2024-09-14T07:12:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.227997+0000", 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.04942154 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.228065+0000", 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8493999999999998e-05 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.228163+0000", 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7539000000000002e-05 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:26580 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1728512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.182410+0000", 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4609911520000001, 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050829382999999999, 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 26580 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.182410+0000", 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.182410+0000", 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.188093+0000", 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056827789999999998 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.188097+0000", 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8639999999999998e-06 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.188103+0000", 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8189999999999997e-06 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.188109+0000", 2024-09-14T07:12:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2700000000000001e-06 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.233068+0000", 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044959037 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.233143+0000", 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5463000000000006e-05 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.233240+0000", 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6150999999999995e-05 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36413 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1691648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039691+0000", 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6037107480000001, 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050874274999999997, 2024-09-14T07:12:21.660 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36413 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039691+0000", 2024-09-14T07:12:21.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039691+0000", 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039691+0000", 2024-09-14T07:12:21.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2799999999999996e-07 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039702+0000", 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0477e-05 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039710+0000", 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4230000000000005e-06 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039716+0000", 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090421+0000", 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050705075000000002 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090493+0000", 2024-09-14T07:12:21.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2096999999999998e-05 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090565+0000", 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2177999999999999e-05 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36414 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1748992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039725+0000", 2024-09-14T07:12:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6036764699999999, 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051015565999999998, 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36414 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039725+0000", 2024-09-14T07:12:21.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039725+0000", 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039725+0000", 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6199999999999998e-07 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039728+0000", 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039735+0000", 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5730000000000002e-06 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039748+0000", 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2711000000000001e-05 2024-09-14T07:12:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090592+0000", 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050844116000000002 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090671+0000", 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9192999999999999e-05 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090740+0000", 2024-09-14T07:12:21.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9043999999999998e-05 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36415 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039756+0000", 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6036453279999998, 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051176395999999999, 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36415 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039756+0000", 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039756+0000", 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039757+0000", 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6499999999999999e-07 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039759+0000", 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2419999999999999e-06 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039767+0000", 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7489999999999998e-06 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039772+0000", 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0119999999999996e-06 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090768+0000", 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.050996905000000002 2024-09-14T07:12:21.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090848+0000", 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0072000000000002e-05 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090932+0000", 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3950999999999996e-05 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36416 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1863680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039778+0000", 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.603623368, 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051392609999999998, 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36416 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.676 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039778+0000", 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039778+0000", 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039778+0000", 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-07 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039780+0000", 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0889999999999998e-06 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039788+0000", 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2710000000000003e-06 2024-09-14T07:12:21.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039793+0000", 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5400000000000003e-06 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.090973+0000", 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051179642999999997 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091051+0000", 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7662000000000003e-05 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091171+0000", 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120016 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36417 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1921024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.680 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039800+0000", 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6036016910000002, 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051563915000000002, 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36417 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039800+0000", 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039800+0000", 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039800+0000", 2024-09-14T07:12:21.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039802+0000", 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039818+0000", 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5761e-05 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039823+0000", 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2630000000000003e-06 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091216+0000", 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051393192999999997 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091294+0000", 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7391000000000005e-05 2024-09-14T07:12:21.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091364+0000", 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9834999999999998e-05 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36418 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039831+0000", 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6035708, 2024-09-14T07:12:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051696804999999998, 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36418 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039831+0000", 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039831+0000", 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039831+0000", 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039833+0000", 2024-09-14T07:12:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.351e-06 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039841+0000", 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6299999999999998e-06 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039846+0000", 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1880000000000001e-06 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091393+0000", 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051546626999999998 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091461+0000", 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8291000000000001e-05 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091527+0000", 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6268999999999999e-05 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36419 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 2035712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039852+0000", 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6035492489999998, 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051830768999999999, 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36419 2024-09-14T07:12:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039852+0000", 2024-09-14T07:12:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039852+0000", 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039852+0000", 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039854+0000", 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.748e-06 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039861+0000", 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7569999999999998e-06 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039866+0000", 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8040000000000001e-06 2024-09-14T07:12:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091553+0000", 2024-09-14T07:12:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051687536999999999 2024-09-14T07:12:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091622+0000", 2024-09-14T07:12:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8662000000000001e-05 2024-09-14T07:12:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091683+0000", 2024-09-14T07:12:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0915999999999997e-05 2024-09-14T07:12:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36420 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 2093056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039871+0000", 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6035301130000001, 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051975414999999997, 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36420 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039871+0000", 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039871+0000", 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039872+0000", 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2300000000000002e-07 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039873+0000", 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7460000000000001e-06 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039886+0000", 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2748999999999999e-05 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039891+0000", 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0640000000000001e-06 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091710+0000", 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.05181844 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091782+0000", 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1951000000000003e-05 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091847+0000", 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5141999999999994e-05 2024-09-14T07:12:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36443 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 299008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039900+0000", 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6035010029999999, 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052121683000000002, 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36443 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039900+0000", 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039900+0000", 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039901+0000", 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1100000000000001e-07 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039903+0000", 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1409999999999999e-06 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039910+0000", 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3300000000000001e-06 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039915+0000", 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1390000000000003e-06 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091877+0000", 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.051961430000000003 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.091952+0000", 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5372999999999998e-05 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092022+0000", 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9858999999999996e-05 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36444 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 356352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039922+0000", 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6034789200000001, 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052261850999999998, 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36444 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039922+0000", 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039922+0000", 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039923+0000", 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039925+0000", 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3070000000000001e-06 2024-09-14T07:12:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039933+0000", 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6190000000000002e-06 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039943+0000", 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9320000000000008e-06 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092050+0000", 2024-09-14T07:12:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052107170000000001 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092122+0000", 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1740000000000001e-05 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092184+0000", 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2673000000000001e-05 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36445 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 413696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039950+0000", 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.603451341, 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052392582, 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36445 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039950+0000", 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039950+0000", 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039951+0000", 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2e-07 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039953+0000", 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5040000000000001e-06 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039960+0000", 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0700000000000001e-06 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039965+0000", 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6650000000000002e-06 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092211+0000", 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052246053000000001 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092277+0000", 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6459999999999997e-05 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092343+0000", 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5309999999999996e-05 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36446 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 471040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039971+0000", 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6034305519999998, 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052525362999999999, 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36446 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039971+0000", 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039971+0000", 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039971+0000", 2024-09-14T07:12:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.96e-07 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039973+0000", 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9740000000000001e-06 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039979+0000", 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1279999999999996e-06 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039983+0000", 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-06 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092369+0000", 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052385747000000003 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092435+0000", 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6543000000000003e-05 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092496+0000", 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0854999999999999e-05 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36447 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 528384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.039996+0000", 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6034054219999998, 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052651112, 2024-09-14T07:12:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36447 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039996+0000", 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039996+0000", 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039996+0000", 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.39e-07 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.039998+0000", 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040005+0000", 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.737e-06 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040010+0000", 2024-09-14T07:12:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9030000000000003e-06 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092521+0000", 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052510711000000002 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092590+0000", 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.949e-05 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092647+0000", 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7040999999999998e-05 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36448 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 585728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.040015+0000", 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6033861150000002, 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052806060000000002, 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36448 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040015+0000", 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040015+0000", 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040016+0000", 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8799999999999998e-07 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040017+0000", 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8390000000000001e-06 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040023+0000", 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1760000000000001e-06 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040027+0000", 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1459999999999998e-06 2024-09-14T07:12:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092680+0000", 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052653094999999997 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092754+0000", 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4238000000000003e-05 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092821+0000", 2024-09-14T07:12:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7278000000000002e-05 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36449 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 643072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.040032+0000", 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6033696389999998, 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052955526000000003, 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36449 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040032+0000", 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040032+0000", 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040032+0000", 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1100000000000002e-07 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040034+0000", 2024-09-14T07:12:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4559999999999999e-06 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040039+0000", 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9630000000000003e-06 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040044+0000", 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3100000000000002e-06 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092849+0000", 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052805719000000001 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092921+0000", 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1044999999999995e-05 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.092987+0000", 2024-09-14T07:12:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6722000000000003e-05 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36450 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 700416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.040049+0000", 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6033527080000001, 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.053103114999999999, 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36450 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040049+0000", 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040049+0000", 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040049+0000", 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2500000000000001e-07 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040051+0000", 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659999999999999e-06 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040057+0000", 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1229999999999997e-06 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040061+0000", 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1320000000000004e-06 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.093015+0000", 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.052953862999999997 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.093091+0000", 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5891999999999998e-05 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.093152+0000", 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1214e-05 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:36451 3.19 3:98c27161:::rbd_data.11824d7f600c.0000000000000019:f [read 757760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:18.040066+0000", 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6033355130000002, 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.053247188000000001, 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 36451 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040066+0000", 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040066+0000", 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040066+0000", 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0400000000000002e-07 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040068+0000", 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5400000000000001e-06 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040074+0000", 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9440000000000002e-06 2024-09-14T07:12:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.040078+0000", 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1790000000000001e-06 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.093180+0000", 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.053101895000000003 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.093253+0000", 2024-09-14T07:12:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2819999999999997e-05 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:18.093313+0000", 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0506e-05 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:21.749 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:21.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:21.751 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:21.750+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:21.851 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:21.851+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:21.905 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-14T07:12:21.924 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:21.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:21.925 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:21.925 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:21.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:21.952 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:21.952+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:21.968 INFO:teuthology.orchestra.run.smithi071.stdout:1684 write 0xda4dafd thru 0xda5af97 (0xd49b bytes) 2024-09-14T07:12:21.973 INFO:teuthology.orchestra.run.smithi071.stdout:1685 write 0x3bccb20 thru 0x3bd77da (0xacbb bytes) 2024-09-14T07:12:21.978 INFO:teuthology.orchestra.run.smithi071.stdout:1686 punch from 0x546a4ff to 0x54796ea, (0xf1eb bytes) 2024-09-14T07:12:21.979 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:21.979 INFO:teuthology.orchestra.run.smithi071.stdout:1689 read 0x2378c9a thru 0x2386220 (0xd587 bytes) 2024-09-14T07:12:21.979 INFO:teuthology.orchestra.run.smithi071.stdout:1690 write 0x642bf90 thru 0x643335f (0x73d0 bytes) 2024-09-14T07:12:21.982 INFO:teuthology.orchestra.run.smithi071.stdout:1691 writesame 0x3250d49 thru 0x3251dc6 data_size 0x1(0x107e bytes) 2024-09-14T07:12:21.986 INFO:teuthology.orchestra.run.smithi071.stdout:1693 read 0x236e50c thru 0x236fda3 (0x1898 bytes) 2024-09-14T07:12:21.987 INFO:teuthology.orchestra.run.smithi071.stdout:1694 punch from 0x4e5f602 to 0x4e6d27c, (0xdc7a bytes) 2024-09-14T07:12:21.987 INFO:teuthology.orchestra.run.smithi071.stdout:1696 read 0x1964651 thru 0x19677e8 (0x3198 bytes) 2024-09-14T07:12:21.987 INFO:teuthology.orchestra.run.smithi071.stdout:1697 write 0x8747d13 thru 0x874d839 (0x5b27 bytes) 2024-09-14T07:12:22.053 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:22.052+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:22.058 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:22.058 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:22.058 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:22.058 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:22.058 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:22.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:22.154 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:22.153+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:22.160 INFO:teuthology.orchestra.run.smithi071.stdout:1698 writesame 0xb85b471 thru 0xb860b00 data_size 0x28(0x5690 bytes) 2024-09-14T07:12:22.161 INFO:teuthology.orchestra.run.smithi071.stdout:1699 write 0x156c5c4 thru 0x15704b5 (0x3ef2 bytes) 2024-09-14T07:12:22.180 INFO:teuthology.orchestra.run.smithi071.stdout:1700 punch from 0xb98e152 to 0xb996ad5, (0x8983 bytes) 2024-09-14T07:12:22.180 INFO:teuthology.orchestra.run.smithi071.stdout:1701 punch from 0x578199f to 0x5784522, (0x2b83 bytes) 2024-09-14T07:12:22.180 INFO:teuthology.orchestra.run.smithi071.stdout:1702 write 0x755dc52 thru 0x756bb54 (0xdf03 bytes) 2024-09-14T07:12:22.181 INFO:teuthology.orchestra.run.smithi071.stdout:1703 write 0x5692411 thru 0x569c9d8 (0xa5c8 bytes) 2024-09-14T07:12:22.182 INFO:teuthology.orchestra.run.smithi071.stdout:1706 read 0xb98e8ab thru 0xb995a7c (0x71d2 bytes) 2024-09-14T07:12:22.183 INFO:teuthology.orchestra.run.smithi071.stdout:1707 read 0x5b30768 thru 0x5b35f83 (0x581c bytes) 2024-09-14T07:12:22.183 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:22.183 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:22.183 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:22.183 INFO:teuthology.orchestra.run.smithi071.stdout:1714 read 0x994eb76 thru 0x995ddf9 (0xf284 bytes) 2024-09-14T07:12:22.191 INFO:teuthology.orchestra.run.smithi071.stdout:1715 trunc from 0xda5af98 to 0x71eff35 2024-09-14T07:12:22.238 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7823 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'32, mlcod=32'30)", 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.504409463000002, 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020025759999999998, 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732726+0000", 2024-09-14T07:12:22.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6799999999999999e-07 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732731+0000", 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6119999999999998e-06 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732742+0000", 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.093e-05 2024-09-14T07:12:22.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732748+0000", 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4990000000000002e-06 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732790+0000", 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531000000000003e-05 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732803+0000", 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3135999999999999e-05 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734693+0000", 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889967 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734727+0000", 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4032999999999998e-05 2024-09-14T07:12:22.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7838 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'34, mlcod=34'32)", 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.492878440999998, 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00194644, 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744257+0000", 2024-09-14T07:12:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0100000000000004e-07 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744263+0000", 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2779999999999999e-06 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744276+0000", 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3335e-05 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744283+0000", 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8750000000000002e-06 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744328+0000", 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5000999999999998e-05 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744348+0000", 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0239000000000001e-05 2024-09-14T07:12:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746170+0000", 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018221859999999999 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746202+0000", 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1724999999999999e-05 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7864 3.9 e34/23 3:9662e057:::rbd_data.1182a7d91484.0000000000000022:head v 34'31, mlcod=32'28)", 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.476820272000001, 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020061520000000002, 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760325+0000", 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0907000000000001e-05 2024-09-14T07:12:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760333+0000", 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2150000000000001e-06 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760348+0000", 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5026e-05 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760405+0000", 2024-09-14T07:12:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6885999999999997e-05 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760426+0000", 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0265e-05 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762272+0000", 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001846349 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762320+0000", 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8106000000000003e-05 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7866 3.4 e34/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:head v 34'37, mlcod=34'34)", 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.474895607000001, 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026596739999999999, 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:12:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762266+0000", 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7076e-05 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762280+0000", 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4004e-05 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762288+0000", 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.678e-06 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762339+0000", 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0430000000000003e-05 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762357+0000", 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8850000000000001e-05 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764858+0000", 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004010000000002 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764898+0000", 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0414000000000003e-05 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.470271010000001, 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.469172121, 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7905 3.4 e34/23 3:20b4893f:::rbd_data.1182a7d91484.0000000000000013:head v 34'39, mlcod=34'35)", 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.444982708000001, 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00219133, 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792152+0000", 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792161+0000", 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3809999999999999e-06 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792177+0000", 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5838e-05 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792185+0000", 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9400000000000002e-06 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792248+0000", 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2928000000000005e-05 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792268+0000", 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0404999999999999e-05 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794300+0000", 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020316819999999999 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794343+0000", 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3183999999999999e-05 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.442328961999999, 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12482 3.0 e37/23 3:04a1ed04:::rbd_data.1182a59bd9ad.0000000000000028:head v 37'42, mlcod=37'39)", 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.155518955, 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028333389999999998, 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081616+0000", 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7300000000000005e-07 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081622+0000", 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-09-14T07:12:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081638+0000", 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6429000000000001e-05 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081646+0000", 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.622e-06 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081706+0000", 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9840000000000003e-05 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081724+0000", 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8150000000000001e-05 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084410+0000", 2024-09-14T07:12:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026862029999999999 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084449+0000", 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8342e-05 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.429034957000001, 2024-09-14T07:12:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.428965543, 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.588587518000001, 2024-09-14T07:12:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4129962799999998, 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:12:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19777 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'87, mlcod=47'85)", 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.839707+0000", 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.397426866, 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001950755, 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839707+0000", 2024-09-14T07:12:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839707+0000", 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839708+0000", 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839712+0000", 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4150000000000001e-06 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839721+0000", 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9230000000000008e-06 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839727+0000", 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839777+0000", 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0142000000000002e-05 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839794+0000", 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7172000000000001e-05 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.841630+0000", 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018360469999999999 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.841658+0000", 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8192999999999999e-05 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1229313840000001, 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:12:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1189030860000004, 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:12:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8979039630000001, 2024-09-14T07:12:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.894386152, 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:12:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43971 3.4 e50/23 3:278d3374:::rbd_data.1182f9393092.0000000000000022:head v 50'120, mlcod=49'118)", 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.3569693199999999, 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002152686, 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880166+0000", 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.437e-06 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880415+0000", 2024-09-14T07:12:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024896599999999999 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880433+0000", 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7768999999999999e-05 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880442+0000", 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.312e-06 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880509+0000", 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6548e-05 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880532+0000", 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3351000000000001e-05 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.882279+0000", 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017470490000000001 2024-09-14T07:12:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.882318+0000", 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8254000000000003e-05 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43989 3.9 e51/23 3:93226f4f:::rbd_data.1182f9393092.0000000000000076:head v 51'118, mlcod=49'115)", 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.43143429900000002, 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029103520000000002, 2024-09-14T07:12:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805706+0000", 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3510000000000001e-06 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805722+0000", 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6087999999999999e-05 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805734+0000", 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.259e-05 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805837+0000", 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103168 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805855+0000", 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8048000000000001e-05 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808571+0000", 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027152500000000002 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808610+0000", 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9530000000000003e-05 2024-09-14T07:12:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:22.334 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:22.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1716 write 0x3a3dbbf thru 0x3a47b0a (0x9f4c bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1720 read 0x351c385 thru 0x351f5f4 (0x3270 bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1721 read 0x4465241 thru 0x446a73e (0x54fe bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1723 read 0x5789f65 thru 0x57921df (0x827b bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1724 write 0x43f0dfa thru 0x43f5f2a (0x5131 bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1725 read 0x38fb0a2 thru 0x38fee73 (0x3dd2 bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1727 read 0x5cf561 thru 0x5d053e (0xfde bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1728 write 0x3efe507 thru 0x3efe55e (0x58 bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1731 write 0x81b804a thru 0x81bf138 (0x70ef bytes) 2024-09-14T07:12:22.337 INFO:teuthology.orchestra.run.smithi071.stdout:1732 write 0x74ee515 thru 0x74f981a (0xb306 bytes) 2024-09-14T07:12:22.338 INFO:teuthology.orchestra.run.smithi071.stdout:1733 clone 18 order 24 su 4194304 sc 2 2024-09-14T07:12:22.338 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:22.334+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:22.436 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:22.435+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:22.479 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:22.479 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:22.480 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:22.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:22.536 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:22.536+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:22.602 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:22.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:22.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:22.633 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:22.633 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:22.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:22.637 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:22.636+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:22.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:22.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:22.653 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:22.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:22.669 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:22.669 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:22.686 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:22.686 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:22.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:22.703 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:22.705 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:22.706 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:22.738 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:22.738+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:22.756 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:22.756 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:22.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:22.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:12:22.838 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:22.838+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:22.874 INFO:teuthology.orchestra.run.smithi071.stdout:flattening image image_client.0-clone17 2024-09-14T07:12:22.876 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:22.877 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:22.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:22.939 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:22.938+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-14T07:12:23.031 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.032 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:23.041 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:23.039+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:23.104 INFO:teuthology.orchestra.run.smithi071.stdout:1734 flatten 2024-09-14T07:12:23.141 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:23.140+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:23.152 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.152 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:23.174 INFO:teuthology.orchestra.run.smithi071.stdout:1735 read 0x667cfa3 thru 0x6680b9a (0x3bf8 bytes) 2024-09-14T07:12:23.181 INFO:teuthology.orchestra.run.smithi071.stdout:1736 trunc from 0x81bf139 to 0xd1b29d9 2024-09-14T07:12:23.185 INFO:teuthology.orchestra.run.smithi071.stdout:1737 write 0xa9420d0 thru 0xa94b0fd (0x902e bytes) 2024-09-14T07:12:23.189 INFO:teuthology.orchestra.run.smithi071.stdout:1738 read 0x3ba248d thru 0x3ba9690 (0x7204 bytes) 2024-09-14T07:12:23.189 INFO:teuthology.orchestra.run.smithi071.stdout:1739 read 0x51ee00a thru 0x51fbcc2 (0xdcb9 bytes) 2024-09-14T07:12:23.189 INFO:teuthology.orchestra.run.smithi071.stdout:1743 write 0x3aa5497 thru 0x3ab10e0 (0xbc4a bytes) 2024-09-14T07:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout:1744 trunc from 0xd1b29d9 to 0x5604399 2024-09-14T07:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout:1746 trunc from 0x5604399 to 0x47f69bb 2024-09-14T07:12:23.219 INFO:teuthology.orchestra.run.smithi071.stdout:1748 punch from 0x1438e6e to 0x1447e5f, (0xeff1 bytes) 2024-09-14T07:12:23.227 INFO:teuthology.orchestra.run.smithi071.stdout:1749 writesame 0x55752ab thru 0x5577a40 data_size 0x9(0x2796 bytes) 2024-09-14T07:12:23.227 INFO:teuthology.orchestra.run.smithi071.stdout:1750 write 0x46c123f thru 0x46c4109 (0x2ecb bytes) 2024-09-14T07:12:23.244 INFO:teuthology.orchestra.run.smithi071.stdout:1751 write 0xe7ef34d thru 0xe7fc15a (0xce0e bytes) 2024-09-14T07:12:23.246 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:23.246+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:23.247 INFO:teuthology.orchestra.run.smithi071.stdout:1752 read 0x840eee0 thru 0x8410df2 (0x1f13 bytes) 2024-09-14T07:12:23.247 INFO:teuthology.orchestra.run.smithi071.stdout:1754 read 0x210c925 thru 0x21144ac (0x7b88 bytes) 2024-09-14T07:12:23.247 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.248 INFO:teuthology.orchestra.run.smithi071.stdout:1757 writesame 0xe10ff6d thru 0xe11258e data_size 0x3(0x2622 bytes) 2024-09-14T07:12:23.251 INFO:teuthology.orchestra.run.smithi071.stdout:1759 punch from 0x466244 to 0x469eda, (0x3c96 bytes) 2024-09-14T07:12:23.251 INFO:teuthology.orchestra.run.smithi071.stdout:1760 write 0xe743b9c thru 0xe7498a2 (0x5d07 bytes) 2024-09-14T07:12:23.252 INFO:teuthology.orchestra.run.smithi071.stdout:1761 write 0xa9d1b87 thru 0xa9de769 (0xcbe3 bytes) 2024-09-14T07:12:23.255 INFO:teuthology.orchestra.run.smithi071.stdout:1764 write 0x86717d5 thru 0x867eb65 (0xd391 bytes) 2024-09-14T07:12:23.258 INFO:teuthology.orchestra.run.smithi071.stdout:1767 writesame 0xc581c99 thru 0xc58923f data_size 0x1(0x75a7 bytes) 2024-09-14T07:12:23.275 INFO:teuthology.orchestra.run.smithi071.stdout:1769 read 0x8d1e2e4 thru 0x8d26ebd (0x8bda bytes) 2024-09-14T07:12:23.275 INFO:teuthology.orchestra.run.smithi071.stdout:1771 writesame 0x87fd2cb thru 0x88020c5 data_size 0x1(0x4dfb bytes) 2024-09-14T07:12:23.281 INFO:teuthology.orchestra.run.smithi071.stdout:1773 read 0x6effffc thru 0x6f09e6e (0x9e73 bytes) 2024-09-14T07:12:23.290 INFO:teuthology.orchestra.run.smithi071.stdout:1774 trunc from 0xe7fc15b to 0x6b14149 2024-09-14T07:12:23.299 INFO:teuthology.orchestra.run.smithi071.stdout:1775 punch from 0x2a8dd36 to 0x2a8fcbe, (0x1f88 bytes) 2024-09-14T07:12:23.305 INFO:teuthology.orchestra.run.smithi071.stdout:1776 trunc from 0x6b14149 to 0xb5b6204 2024-09-14T07:12:23.307 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.307 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.309 INFO:teuthology.orchestra.run.smithi071.stdout:1777 write 0x9575071 thru 0x9578ec7 (0x3e57 bytes) 2024-09-14T07:12:23.312 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.312 INFO:teuthology.orchestra.run.smithi071.stdout:1779 writesame 0x2f50c08 thru 0x2f57ec9 data_size 0x25(0x72c2 bytes) 2024-09-14T07:12:23.313 INFO:teuthology.orchestra.run.smithi071.stdout:1781 writesame 0x79ef788 thru 0x79f107c data_size 0x1(0x18f5 bytes) 2024-09-14T07:12:23.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:23.318 INFO:teuthology.orchestra.run.smithi071.stdout:1782 read 0x9509df2 thru 0x95185ba (0xe7c9 bytes) 2024-09-14T07:12:23.318 INFO:teuthology.orchestra.run.smithi071.stdout:1783 punch from 0xdef55c to 0xdef8b2, (0x356 bytes) 2024-09-14T07:12:23.327 INFO:teuthology.orchestra.run.smithi071.stdout:1784 trunc from 0xb5b6204 to 0x3af96e6 2024-09-14T07:12:23.337 INFO:teuthology.orchestra.run.smithi071.stdout:1785 read 0x2034c3c thru 0x20375b4 (0x2979 bytes) 2024-09-14T07:12:23.350 INFO:teuthology.orchestra.run.smithi071.stdout:1786 trunc from 0x3af96e6 to 0xe026f23 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:1787 read 0xc2530a2 thru 0xc25793f (0x489e bytes) 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:1790 punch from 0x85a7229 to 0x85b13ad, (0xa184 bytes) 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:1791 read 0x9658df1 thru 0x96623ea (0x95fa bytes) 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.355 INFO:teuthology.orchestra.run.smithi071.stdout:1793 write 0x8b51726 thru 0x8b563b8 (0x4c93 bytes) 2024-09-14T07:12:23.357 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:23.356+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:23.357 INFO:teuthology.orchestra.run.smithi071.stdout:1794 write 0xa5e7d4f thru 0xa5f47ef (0xcaa1 bytes) 2024-09-14T07:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout:1795 write 0x2b14605 thru 0x2b23ff9 (0xf9f5 bytes) 2024-09-14T07:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout:1796 write 0x2ceb7dd thru 0x2cf9619 (0xde3d bytes) 2024-09-14T07:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout:1797 read 0x1f3ce57 thru 0x1f48666 (0xb810 bytes) 2024-09-14T07:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout:1798 read 0x53ac75e thru 0x53acb70 (0x413 bytes) 2024-09-14T07:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout:1799 write 0x92d7539 thru 0x92dfc4d (0x8715 bytes) 2024-09-14T07:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout:1800 read 0x2b976dd thru 0x2b9beaa (0x47ce bytes) 2024-09-14T07:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout:1802 trunc from 0xe026f23 to 0x3247b4 2024-09-14T07:12:23.404 INFO:teuthology.orchestra.run.smithi071.stdout:1803 write 0x30dd547 thru 0x30e2a69 (0x5523 bytes) 2024-09-14T07:12:23.406 INFO:teuthology.orchestra.run.smithi071.stdout:1804 writesame 0xed29c2 thru 0xedac5f data_size 0x3(0x829e bytes) 2024-09-14T07:12:23.414 INFO:teuthology.orchestra.run.smithi071.stdout:1805 punch from 0xc52195 to 0xc56420, (0x428b bytes) 2024-09-14T07:12:23.432 INFO:teuthology.orchestra.run.smithi071.stdout:1806 writesame 0xbaa9c2d thru 0xbaaa6c1 data_size 0x15(0xa95 bytes) 2024-09-14T07:12:23.440 INFO:teuthology.orchestra.run.smithi071.stdout:1807 writesame 0xee062c9 thru 0xee07187 data_size 0x5(0xebf bytes) 2024-09-14T07:12:23.440 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.440 INFO:teuthology.orchestra.run.smithi071.stdout:1809 read 0xea13adb thru 0xea18205 (0x472b bytes) 2024-09-14T07:12:23.440 INFO:teuthology.orchestra.run.smithi071.stdout:1811 write 0x39caf1 thru 0x39e58f (0x1a9f bytes) 2024-09-14T07:12:23.441 INFO:teuthology.orchestra.run.smithi071.stdout:1812 write 0x1d792c9 thru 0x1d84425 (0xb15d bytes) 2024-09-14T07:12:23.443 INFO:teuthology.orchestra.run.smithi071.stdout:1813 write 0xaf6aa68 thru 0xaf6ca65 (0x1ffe bytes) 2024-09-14T07:12:23.443 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:23.442+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:23.445 INFO:teuthology.orchestra.run.smithi071.stdout:1814 trunc from 0xee07188 to 0xec7bf52 2024-09-14T07:12:23.450 INFO:teuthology.orchestra.run.smithi071.stdout:1815 write 0x8bcaa9e thru 0x8bd9fd0 (0xf533 bytes) 2024-09-14T07:12:23.452 INFO:teuthology.orchestra.run.smithi071.stdout:1817 writesame 0xbfc68b6 thru 0xbfd03c8 data_size 0x9(0x9b13 bytes) 2024-09-14T07:12:23.455 INFO:teuthology.orchestra.run.smithi071.stdout:1818 punch from 0x5c956d8 to 0x5ca494e, (0xf276 bytes) 2024-09-14T07:12:23.455 INFO:teuthology.orchestra.run.smithi071.stdout:1819 writesame 0xb9cb955 thru 0xb9d3909 data_size 0x1(0x7fb5 bytes) 2024-09-14T07:12:23.462 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.462 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.470 INFO:teuthology.orchestra.run.smithi071.stdout:1820 read 0x22e555e thru 0x22ebdd9 (0x687c bytes) 2024-09-14T07:12:23.471 INFO:teuthology.orchestra.run.smithi071.stdout:1822 write 0x9c3f354 thru 0x9c4003d (0xcea bytes) 2024-09-14T07:12:23.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:23.474 INFO:teuthology.orchestra.run.smithi071.stdout:1824 write 0xde0e90e thru 0xde0ec72 (0x365 bytes) 2024-09-14T07:12:23.477 INFO:teuthology.orchestra.run.smithi071.stdout:1826 write 0x27fe9c3 thru 0x28046aa (0x5ce8 bytes) 2024-09-14T07:12:23.479 INFO:teuthology.orchestra.run.smithi071.stdout:1827 punch from 0x772b4b1 to 0x773777a, (0xc2c9 bytes) 2024-09-14T07:12:23.480 INFO:teuthology.orchestra.run.smithi071.stdout:1828 write 0x74eb420 thru 0x74f40cf (0x8cb0 bytes) 2024-09-14T07:12:23.483 INFO:teuthology.orchestra.run.smithi071.stdout:1829 punch from 0xb85bdb0 to 0xb861304, (0x5554 bytes) 2024-09-14T07:12:23.483 INFO:teuthology.orchestra.run.smithi071.stdout:1830 punch from 0xc26363c to 0xc26b516, (0x7eda bytes) 2024-09-14T07:12:23.483 INFO:teuthology.orchestra.run.smithi071.stdout:1832 read 0x315896c thru 0x31641db (0xb870 bytes) 2024-09-14T07:12:23.483 INFO:teuthology.orchestra.run.smithi071.stdout:1833 punch from 0x7c0b873 to 0x7c12a86, (0x7213 bytes) 2024-09-14T07:12:23.495 INFO:teuthology.orchestra.run.smithi071.stdout:1834 trunc from 0xec7bf52 to 0x4875627 2024-09-14T07:12:23.508 INFO:teuthology.orchestra.run.smithi071.stdout:1835 punch from 0x1c33559 to 0x1c3b630, (0x80d7 bytes) 2024-09-14T07:12:23.508 INFO:teuthology.orchestra.run.smithi071.stdout:1836 read 0x19e3af thru 0x1a414d (0x5d9f bytes) 2024-09-14T07:12:23.508 INFO:teuthology.orchestra.run.smithi071.stdout:1837 read 0x364b24d thru 0x364c928 (0x16dc bytes) 2024-09-14T07:12:23.517 INFO:teuthology.orchestra.run.smithi071.stdout:1839 trunc from 0x4875627 to 0xb46474b 2024-09-14T07:12:23.523 INFO:teuthology.orchestra.run.smithi071.stdout:1841 read 0x71c6580 thru 0x71c9db7 (0x3838 bytes) 2024-09-14T07:12:23.523 INFO:teuthology.orchestra.run.smithi071.stdout:1842 read 0x15cc817 thru 0x15dbae7 (0xf2d1 bytes) 2024-09-14T07:12:23.524 INFO:teuthology.orchestra.run.smithi071.stdout:1845 read 0x2c4751d thru 0x2c53be1 (0xc6c5 bytes) 2024-09-14T07:12:23.524 INFO:teuthology.orchestra.run.smithi071.stdout:1846 write 0x5285213 thru 0x52912d7 (0xc0c5 bytes) 2024-09-14T07:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout:1847 read 0x30c31f6 thru 0x30d1fef (0xedfa bytes) 2024-09-14T07:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout:1848 punch from 0x9257e5b to 0x92590c0, (0x1265 bytes) 2024-09-14T07:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout:1851 read 0x201c2d2 thru 0x2028b47 (0xc876 bytes) 2024-09-14T07:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout:1853 punch from 0x27a64b to 0x27d37e, (0x2d33 bytes) 2024-09-14T07:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout:1854 trunc from 0xb46474b to 0xeb50f78 2024-09-14T07:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout:1855 write 0xa16546c thru 0xa16dbb9 (0x874e bytes) 2024-09-14T07:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout:1856 read 0x23c7518 thru 0x23d33a9 (0xbe92 bytes) 2024-09-14T07:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout:1857 writesame 0x451f301 thru 0x452c446 data_size 0x3(0xd146 bytes) 2024-09-14T07:12:23.544 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:23.543+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout:1858 writesame 0x91db789 thru 0x91e8e00 data_size 0x4(0xd678 bytes) 2024-09-14T07:12:23.576 INFO:teuthology.orchestra.run.smithi071.stdout:1859 trunc from 0xeb50f78 to 0x58feb3 2024-09-14T07:12:23.589 INFO:teuthology.orchestra.run.smithi071.stdout:1860 read 0x44789a thru 0x4506ef (0x8e56 bytes) 2024-09-14T07:12:23.611 INFO:teuthology.orchestra.run.smithi071.stdout:1861 write 0xe83aa13 thru 0xe841234 (0x6822 bytes) 2024-09-14T07:12:23.615 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.615 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:23.626 INFO:teuthology.orchestra.run.smithi071.stdout:1862 trunc from 0xe841235 to 0x3a48f27 2024-09-14T07:12:23.635 INFO:teuthology.orchestra.run.smithi071.stdout:1864 trunc from 0x3a48f27 to 0x3200c3d 2024-09-14T07:12:23.656 INFO:teuthology.orchestra.run.smithi071.stdout:1865 write 0xc9e6a59 thru 0xc9e9e19 (0x33c1 bytes) 2024-09-14T07:12:23.658 INFO:teuthology.orchestra.run.smithi071.stdout:1866 write 0xb694b50 thru 0xb699c25 (0x50d6 bytes) 2024-09-14T07:12:23.661 INFO:teuthology.orchestra.run.smithi071.stdout:1868 read 0x27200fa thru 0x2721d40 (0x1c47 bytes) 2024-09-14T07:12:23.666 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:23.666+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:23.668 INFO:teuthology.orchestra.run.smithi071.stdout:1871 writesame 0xe6e29e5 thru 0xe6f292e data_size 0x29(0xff4a bytes) 2024-09-14T07:12:23.669 INFO:teuthology.orchestra.run.smithi071.stdout:1872 read 0xb633e4e thru 0xb63e371 (0xa524 bytes) 2024-09-14T07:12:23.669 INFO:teuthology.orchestra.run.smithi071.stdout:1873 punch from 0x858cbc5 to 0x8591469, (0x48a4 bytes) 2024-09-14T07:12:23.669 INFO:teuthology.orchestra.run.smithi071.stdout:1874 read 0x19bfc8d thru 0x19c1698 (0x1a0c bytes) 2024-09-14T07:12:23.669 INFO:teuthology.orchestra.run.smithi071.stdout:1875 write 0xd7b697f thru 0xd7c60ea (0xf76c bytes) 2024-09-14T07:12:23.672 INFO:teuthology.orchestra.run.smithi071.stdout:1877 read 0x1c16516 thru 0x1c1cb31 (0x661c bytes) 2024-09-14T07:12:23.672 INFO:teuthology.orchestra.run.smithi071.stdout:1879 read 0x336d5be thru 0x33711c7 (0x3c0a bytes) 2024-09-14T07:12:23.672 INFO:teuthology.orchestra.run.smithi071.stdout:1880 write 0xcb86456 thru 0xcb95968 (0xf513 bytes) 2024-09-14T07:12:23.673 INFO:teuthology.orchestra.run.smithi071.stdout:1881 read 0xa3baad5 thru 0xa3c6e29 (0xc355 bytes) 2024-09-14T07:12:23.673 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.674 INFO:teuthology.orchestra.run.smithi071.stdout:1883 writesame 0xdb6434c thru 0xdb67824 data_size 0x1(0x34d9 bytes) 2024-09-14T07:12:23.678 INFO:teuthology.orchestra.run.smithi071.stdout:1885 write 0x391354f thru 0x3916ae5 (0x3597 bytes) 2024-09-14T07:12:23.680 INFO:teuthology.orchestra.run.smithi071.stdout:1886 punch from 0x49f88af to 0x4a06822, (0xdf73 bytes) 2024-09-14T07:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout:1888 trunc from 0xe6f292f to 0x3f1d7c3 2024-09-14T07:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout:1889 write 0x7896c73 thru 0x789e6d0 (0x7a5e bytes) 2024-09-14T07:12:23.714 INFO:teuthology.orchestra.run.smithi071.stdout:1890 writesame 0x2ed4e1d thru 0x2ee0e5a data_size 0x1(0xc03e bytes) 2024-09-14T07:12:23.727 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.727 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.733 INFO:teuthology.orchestra.run.smithi071.stdout:1891 write 0x49aa67c thru 0x49b8226 (0xdbab bytes) 2024-09-14T07:12:23.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:23.737 INFO:teuthology.orchestra.run.smithi071.stdout:1892 write 0x48c6fbb thru 0x48d58dd (0xe923 bytes) 2024-09-14T07:12:23.737 INFO:teuthology.orchestra.run.smithi071.stdout:1893 punch from 0x89e515 to 0x8a5fd3, (0x7abe bytes) 2024-09-14T07:12:23.746 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:23.745+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:23.747 INFO:teuthology.orchestra.run.smithi071.stdout:1895 write 0xc1dd015 thru 0xc1dd07d (0x69 bytes) 2024-09-14T07:12:23.749 INFO:teuthology.orchestra.run.smithi071.stdout:1896 write 0x4c8e344 thru 0x4c965f9 (0x82b6 bytes) 2024-09-14T07:12:23.752 INFO:teuthology.orchestra.run.smithi071.stdout:1897 write 0x48e8bf1 thru 0x48ec29e (0x36ae bytes) 2024-09-14T07:12:23.753 INFO:teuthology.orchestra.run.smithi071.stdout:1898 writesame 0x981cb95 thru 0x981ce38 data_size 0xd(0x2a4 bytes) 2024-09-14T07:12:23.755 INFO:teuthology.orchestra.run.smithi071.stdout:1899 write 0xa8f8285 thru 0xa8fbb59 (0x38d5 bytes) 2024-09-14T07:12:23.758 INFO:teuthology.orchestra.run.smithi071.stdout:1900 read 0x6027872 thru 0x603163a (0x9dc9 bytes) 2024-09-14T07:12:23.758 INFO:teuthology.orchestra.run.smithi071.stdout:1901 punch from 0x6bcf099 to 0x6bd1f82, (0x2ee9 bytes) 2024-09-14T07:12:23.764 INFO:teuthology.orchestra.run.smithi071.stdout:1902 trunc from 0xc1dd07e to 0x73517b5 2024-09-14T07:12:23.774 INFO:teuthology.orchestra.run.smithi071.stdout:1904 read 0x63017bb thru 0x6308c8d (0x74d3 bytes) 2024-09-14T07:12:23.774 INFO:teuthology.orchestra.run.smithi071.stdout:1905 write 0x4a9040a thru 0x4a94e1e (0x4a15 bytes) 2024-09-14T07:12:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:1906 punch from 0x256a44 to 0x2605a4, (0x9b60 bytes) 2024-09-14T07:12:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:1907 punch from 0x71a8be1 to 0x71ad83a, (0x4c59 bytes) 2024-09-14T07:12:23.776 INFO:teuthology.orchestra.run.smithi071.stdout:1908 write 0x118b2c6 thru 0x11979ea (0xc725 bytes) 2024-09-14T07:12:23.787 INFO:teuthology.orchestra.run.smithi071.stdout:1911 write 0xb3f553b thru 0xb3ffaed (0xa5b3 bytes) 2024-09-14T07:12:23.794 INFO:teuthology.orchestra.run.smithi071.stdout:1914 trunc from 0xb3ffaee to 0x717e0c2 2024-09-14T07:12:23.807 INFO:teuthology.orchestra.run.smithi071.stdout:1915 read 0x442544b thru 0x44290fe (0x3cb4 bytes) 2024-09-14T07:12:23.808 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.813 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:12:23.820 INFO:teuthology.orchestra.run.smithi071.stdout:1921 writesame 0xa02c8d1 thru 0xa035cda data_size 0x7(0x940a bytes) 2024-09-14T07:12:23.820 INFO:teuthology.orchestra.run.smithi071.stdout:1922 punch from 0x9219177 to 0x921a554, (0x13dd bytes) 2024-09-14T07:12:23.825 INFO:teuthology.orchestra.run.smithi071.stdout:1925 trunc from 0xa035cdb to 0x65e0104 2024-09-14T07:12:23.831 INFO:teuthology.orchestra.run.smithi071.stdout:1926 read 0x41df615 thru 0x41e4ecc (0x58b8 bytes) 2024-09-14T07:12:23.831 INFO:teuthology.orchestra.run.smithi071.stdout:1927 writesame 0x257120f thru 0x2574fe3 data_size 0x1(0x3dd5 bytes) 2024-09-14T07:12:23.836 INFO:teuthology.orchestra.run.smithi071.stdout:1929 punch from 0x3ea10b6 to 0x3ea6769, (0x56b3 bytes) 2024-09-14T07:12:23.837 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.837 INFO:teuthology.orchestra.run.smithi071.stdout:1932 trunc from 0x65e0104 to 0x5d4083b 2024-09-14T07:12:23.847 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:23.846+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout:1933 write 0xaf46cfd thru 0xaf4f296 (0x859a bytes) 2024-09-14T07:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout:1934 punch from 0x9921b17 to 0x992a43e, (0x8927 bytes) 2024-09-14T07:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout:1935 writesame 0x5cf9d9 thru 0x5dd2e4 data_size 0x3a(0xd90c bytes) 2024-09-14T07:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout:1936 writesame 0xb072fdd thru 0xb078114 data_size 0x8(0x5138 bytes) 2024-09-14T07:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout:1937 read 0x8030622 thru 0x80405c4 (0xffa3 bytes) 2024-09-14T07:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout:1940 write 0x320f060 thru 0x3214108 (0x50a9 bytes) 2024-09-14T07:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout:1941 writesame 0x1aa2c18 thru 0x1ab2a9a data_size 0x5(0xfe83 bytes) 2024-09-14T07:12:23.881 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:23.881 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:23.888 INFO:teuthology.orchestra.run.smithi071.stdout:1942 trunc from 0xb078115 to 0x654f48d 2024-09-14T07:12:23.890 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:23.899 INFO:teuthology.orchestra.run.smithi071.stdout:1943 read 0x117cf14 thru 0x117fbfb (0x2ce8 bytes) 2024-09-14T07:12:23.899 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.908 INFO:teuthology.orchestra.run.smithi071.stdout:1945 write 0x8235a6f thru 0x8235c39 (0x1cb bytes) 2024-09-14T07:12:23.912 INFO:teuthology.orchestra.run.smithi071.stdout:1948 read 0x71e0e28 thru 0x71e5a5b (0x4c34 bytes) 2024-09-14T07:12:23.913 INFO:teuthology.orchestra.run.smithi071.stdout:1951 write 0x6957ce6 thru 0x695a191 (0x24ac bytes) 2024-09-14T07:12:23.915 INFO:teuthology.orchestra.run.smithi071.stdout:1952 read 0x27a8387 thru 0x27aa5eb (0x2265 bytes) 2024-09-14T07:12:23.915 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.915 INFO:teuthology.orchestra.run.smithi071.stdout:1955 read 0x5b270d6 thru 0x5b27e58 (0xd83 bytes) 2024-09-14T07:12:23.923 INFO:teuthology.orchestra.run.smithi071.stdout:1956 trunc from 0x8235c3a to 0x198843f 2024-09-14T07:12:23.948 INFO:teuthology.orchestra.run.smithi071.stdout:1957 trunc from 0x198843f to 0xbd0614f 2024-09-14T07:12:23.948 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:23.947+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:23.953 INFO:teuthology.orchestra.run.smithi071.stdout:1958 writesame 0x1e50bce thru 0x1e5e8ee data_size 0x1(0xdd21 bytes) 2024-09-14T07:12:23.983 INFO:teuthology.orchestra.run.smithi071.stdout:1960 punch from 0xb816c4d to 0xb825b09, (0xeebc bytes) 2024-09-14T07:12:23.983 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:23.988 INFO:teuthology.orchestra.run.smithi071.stdout:1962 writesame 0xc444c02 thru 0xc446698 data_size 0x1(0x1a97 bytes) 2024-09-14T07:12:23.988 INFO:teuthology.orchestra.run.smithi071.stdout:1963 writesame 0x1d062e4 thru 0x1d150bb data_size 0x18(0xedd8 bytes) 2024-09-14T07:12:23.993 INFO:teuthology.orchestra.run.smithi071.stdout:1964 trunc from 0xc446699 to 0x9357f11 2024-09-14T07:12:23.999 INFO:teuthology.orchestra.run.smithi071.stdout:1965 write 0x5881985 thru 0x588bca0 (0xa31c bytes) 2024-09-14T07:12:24.003 INFO:teuthology.orchestra.run.smithi071.stdout:1966 trunc from 0x9357f11 to 0x8145ece 2024-09-14T07:12:24.016 INFO:teuthology.orchestra.run.smithi071.stdout:1967 write 0x956c417 thru 0x956e7c6 (0x23b0 bytes) 2024-09-14T07:12:24.024 INFO:teuthology.orchestra.run.smithi071.stdout:1968 write 0x9f863de thru 0x9f8b0d1 (0x4cf4 bytes) 2024-09-14T07:12:24.025 INFO:teuthology.orchestra.run.smithi071.stdout:1969 writesame 0x672968c thru 0x67336f3 data_size 0xae(0xa068 bytes) 2024-09-14T07:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout:1970 write 0xbaef1ba thru 0xbaf1132 (0x1f79 bytes) 2024-09-14T07:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout:1971 read 0xb2a36f7 thru 0xb2ab785 (0x808f bytes) 2024-09-14T07:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout:1972 write 0x829c13 thru 0x832ccb (0x90b9 bytes) 2024-09-14T07:12:24.039 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.039 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout:1973 read 0x5754a85 thru 0x575b164 (0x66e0 bytes) 2024-09-14T07:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout:1975 punch from 0x3b1d582 to 0x3b24390, (0x6e0e bytes) 2024-09-14T07:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout:1976 punch from 0x1cc3b05 to 0x1cc7fb4, (0x44af bytes) 2024-09-14T07:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout:1977 write 0xbce305a thru 0xbcf0a78 (0xda1f bytes) 2024-09-14T07:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout:1981 read 0x15dd99e thru 0x15df121 (0x1784 bytes) 2024-09-14T07:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout:1982 write 0x54e020 thru 0x556f94 (0x8f75 bytes) 2024-09-14T07:12:24.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:24.049 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:24.047+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout:1983 writesame 0xa0489a4 thru 0xa054dce data_size 0x1(0xc42b bytes) 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:1984 read 0x5baedb9 thru 0x5bb9969 (0xabb1 bytes) 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:1987 read 0x7241bd1 thru 0x724edb7 (0xd1e7 bytes) 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:1989 read 0x5c11cf1 thru 0x5c1cae1 (0xadf1 bytes) 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:1992 read 0x207e121 thru 0x2082bd0 (0x4ab0 bytes) 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:1994 punch from 0x157e7c7 to 0x158131a, (0x2b53 bytes) 2024-09-14T07:12:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:1995 read 0x76b9699 thru 0x76bf4ed (0x5e55 bytes) 2024-09-14T07:12:24.076 INFO:teuthology.orchestra.run.smithi071.stdout:1996 punch from 0x8f8c97 to 0x8fe812, (0x5b7b bytes) 2024-09-14T07:12:24.076 INFO:teuthology.orchestra.run.smithi071.stdout:1998 punch from 0xa4e4be8 to 0xa4ed099, (0x84b1 bytes) 2024-09-14T07:12:24.076 INFO:teuthology.orchestra.run.smithi071.stdout:1999 read 0x8d32ffb thru 0x8d3e531 (0xb537 bytes) 2024-09-14T07:12:24.087 INFO:teuthology.orchestra.run.smithi071.stdout:2001 trunc from 0xbcf0a79 to 0x1edf3e5 2024-09-14T07:12:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:2002 read 0xc897dc thru 0xc98905 (0xf12a bytes) 2024-09-14T07:12:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:2009 read 0xb08de2 thru 0xb18c2f (0xfe4e bytes) 2024-09-14T07:12:24.100 INFO:teuthology.orchestra.run.smithi071.stdout:2010 punch from 0x189ca87 to 0x18ac147, (0xf6c0 bytes) 2024-09-14T07:12:24.100 INFO:teuthology.orchestra.run.smithi071.stdout:2012 punch from 0x1cd052e to 0x1cdea16, (0xe4e8 bytes) 2024-09-14T07:12:24.108 INFO:teuthology.orchestra.run.smithi071.stdout:2013 write 0x4d7e5e1 thru 0x4d8b60a (0xd02a bytes) 2024-09-14T07:12:24.121 INFO:teuthology.orchestra.run.smithi071.stdout:2014 write 0xa02a7a4 thru 0xa02b2d1 (0xb2e bytes) 2024-09-14T07:12:24.124 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.124 INFO:teuthology.orchestra.run.smithi071.stdout:2018 read 0x640a22f thru 0x6410d6d (0x6b3f bytes) 2024-09-14T07:12:24.124 INFO:teuthology.orchestra.run.smithi071.stdout:2022 read 0x8a6a74b thru 0x8a70f88 (0x683e bytes) 2024-09-14T07:12:24.130 INFO:teuthology.orchestra.run.smithi071.stdout:2023 write 0xb740b6c thru 0xb741d51 (0x11e6 bytes) 2024-09-14T07:12:24.143 INFO:teuthology.orchestra.run.smithi071.stdout:2024 writesame 0xe390782 thru 0xe394e8c data_size 0x1(0x470b bytes) 2024-09-14T07:12:24.144 INFO:teuthology.orchestra.run.smithi071.stdout:2025 write 0x938e156 thru 0x939d296 (0xf141 bytes) 2024-09-14T07:12:24.149 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:24.148+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:24.151 INFO:teuthology.orchestra.run.smithi071.stdout:2026 trunc from 0xe394e8d to 0xb05f23c 2024-09-14T07:12:24.165 INFO:teuthology.orchestra.run.smithi071.stdout:2027 writesame 0xcd45c75 thru 0xcd50975 data_size 0x6f(0xad01 bytes) 2024-09-14T07:12:24.170 INFO:teuthology.orchestra.run.smithi071.stdout:2028 writesame 0xd74343c thru 0xd745f41 data_size 0x1(0x2b06 bytes) 2024-09-14T07:12:24.181 INFO:teuthology.orchestra.run.smithi071.stdout:2030 trunc from 0xd745f42 to 0x528835d 2024-09-14T07:12:24.182 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.182 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:24.194 INFO:teuthology.orchestra.run.smithi071.stdout:2031 trunc from 0x528835d to 0x30620be 2024-09-14T07:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout:2033 write 0x8234575 thru 0x82376ef (0x317b bytes) 2024-09-14T07:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout:2034 read 0x48ba5a9 thru 0x48c8b3d (0xe595 bytes) 2024-09-14T07:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout:2037 trunc from 0x82376f0 to 0x163763a 2024-09-14T07:12:24.237 INFO:teuthology.orchestra.run.smithi071.stdout:2038 trunc from 0x163763a to 0x1d002a3 2024-09-14T07:12:24.241 INFO:teuthology.orchestra.run.smithi071.stdout:2039 punch from 0x1185701 to 0x118fc67, (0xa566 bytes) 2024-09-14T07:12:24.242 INFO:teuthology.orchestra.run.smithi071.stdout:2040 read 0x11dfbc0 thru 0x11ebd78 (0xc1b9 bytes) 2024-09-14T07:12:24.250 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:24.249+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:24.262 INFO:teuthology.orchestra.run.smithi071.stdout:2041 write 0xe175d34 thru 0xe184f1a (0xf1e7 bytes) 2024-09-14T07:12:24.264 INFO:teuthology.orchestra.run.smithi071.stdout:2042 write 0xdfb6174 thru 0xdfbdaa3 (0x7930 bytes) 2024-09-14T07:12:24.267 INFO:teuthology.orchestra.run.smithi071.stdout:2043 write 0x65a2b25 thru 0x65a2d11 (0x1ed bytes) 2024-09-14T07:12:24.270 INFO:teuthology.orchestra.run.smithi071.stdout:2044 punch from 0x4e474b0 to 0x4e5605d, (0xebad bytes) 2024-09-14T07:12:24.270 INFO:teuthology.orchestra.run.smithi071.stdout:2046 read 0x802a600 thru 0x8032ece (0x88cf bytes) 2024-09-14T07:12:24.270 INFO:teuthology.orchestra.run.smithi071.stdout:2049 writesame 0xd1eb833 thru 0xd1f2dcc data_size 0x1(0x759a bytes) 2024-09-14T07:12:24.281 INFO:teuthology.orchestra.run.smithi071.stdout:2050 write 0x605797d thru 0x606543f (0xdac3 bytes) 2024-09-14T07:12:24.284 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.284 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.284 INFO:teuthology.orchestra.run.smithi071.stdout:2053 read 0x80b82f6 thru 0x80c69eb (0xe6f6 bytes) 2024-09-14T07:12:24.285 INFO:teuthology.orchestra.run.smithi071.stdout:2054 read 0x153eec6 thru 0x154e6dc (0xf817 bytes) 2024-09-14T07:12:24.285 INFO:teuthology.orchestra.run.smithi071.stdout:2055 read 0xba02a1e thru 0xba0865b (0x5c3e bytes) 2024-09-14T07:12:24.286 INFO:teuthology.orchestra.run.smithi071.stdout:2057 read 0x971bcaf thru 0x97262cf (0xa621 bytes) 2024-09-14T07:12:24.286 INFO:teuthology.orchestra.run.smithi071.stdout:2058 punch from 0xaff6296 to 0xaff740a, (0x1174 bytes) 2024-09-14T07:12:24.286 INFO:teuthology.orchestra.run.smithi071.stdout:2059 write 0x267c78e thru 0x2688669 (0xbedc bytes) 2024-09-14T07:12:24.287 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.287 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.287 INFO:teuthology.orchestra.run.smithi071.stdout:2070 read 0x53686a thru 0x538934 (0x20cb bytes) 2024-09-14T07:12:24.288 INFO:teuthology.orchestra.run.smithi071.stdout:2071 writesame 0x1cfaaf5 thru 0x1cfbbab data_size 0x1(0x10b7 bytes) 2024-09-14T07:12:24.292 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.292 INFO:teuthology.orchestra.run.smithi071.stdout:2073 write 0x841a96e thru 0x84216de (0x6d71 bytes) 2024-09-14T07:12:24.293 INFO:teuthology.orchestra.run.smithi071.stdout:2074 read 0x74ec173 thru 0x74ee754 (0x25e2 bytes) 2024-09-14T07:12:24.293 INFO:teuthology.orchestra.run.smithi071.stdout:2075 read 0xc07b0d4 thru 0xc082343 (0x7270 bytes) 2024-09-14T07:12:24.294 INFO:teuthology.orchestra.run.smithi071.stdout:2076 writesame 0x7bfa108 thru 0x7bfed44 data_size 0x1(0x4c3d bytes) 2024-09-14T07:12:24.303 INFO:teuthology.orchestra.run.smithi071.stdout:2077 write 0x4cafdaa thru 0x4cbe1b2 (0xe409 bytes) 2024-09-14T07:12:24.306 INFO:teuthology.orchestra.run.smithi071.stdout:2078 read 0xdd43da7 thru 0xdd4ce4c (0x90a6 bytes) 2024-09-14T07:12:24.307 INFO:teuthology.orchestra.run.smithi071.stdout:2079 read 0x793175 thru 0x79ce59 (0x9ce5 bytes) 2024-09-14T07:12:24.307 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.307 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.311 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.311 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.314 INFO:teuthology.orchestra.run.smithi071.stdout:2088 trunc from 0xe184f1b to 0x86fd413 2024-09-14T07:12:24.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:24.325 INFO:teuthology.orchestra.run.smithi071.stdout:2089 write 0x6fb7c60 thru 0x6fbdb27 (0x5ec8 bytes) 2024-09-14T07:12:24.326 INFO:teuthology.orchestra.run.smithi071.stdout:2090 read 0x5c06119 thru 0x5c0b746 (0x562e bytes) 2024-09-14T07:12:24.328 INFO:teuthology.orchestra.run.smithi071.stdout:2091 trunc from 0x86fd413 to 0xa241b40 2024-09-14T07:12:24.334 INFO:teuthology.orchestra.run.smithi071.stdout:2094 read 0x79d550a thru 0x79d9409 (0x3f00 bytes) 2024-09-14T07:12:24.334 INFO:teuthology.orchestra.run.smithi071.stdout:2095 read 0x4deb6f thru 0x4ed185 (0xe617 bytes) 2024-09-14T07:12:24.337 INFO:teuthology.orchestra.run.smithi071.stdout:2096 trunc from 0xa241b40 to 0xc2257c2 2024-09-14T07:12:24.342 INFO:teuthology.orchestra.run.smithi071.stdout:2097 write 0xa1b5b2e thru 0xa1bf4ce (0x99a1 bytes) 2024-09-14T07:12:24.344 INFO:teuthology.orchestra.run.smithi071.stdout:2098 write 0x7f271cb thru 0x7f30235 (0x906b bytes) 2024-09-14T07:12:24.346 INFO:teuthology.orchestra.run.smithi071.stdout:2101 write 0x190a6de thru 0x19105eb (0x5f0e bytes) 2024-09-14T07:12:24.351 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:24.350+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:24.355 INFO:teuthology.orchestra.run.smithi071.stdout:2102 writesame 0xecfa8c9 thru 0xed0a4a4 data_size 0x6c(0xfbdc bytes) 2024-09-14T07:12:24.356 INFO:teuthology.orchestra.run.smithi071.stdout:2103 write 0x8967f7f thru 0x896a053 (0x20d5 bytes) 2024-09-14T07:12:24.368 INFO:teuthology.orchestra.run.smithi071.stdout:2106 trunc from 0xed0a4a5 to 0x6d6bf7a 2024-09-14T07:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:2107 punch from 0x2a11c98 to 0x2a198d0, (0x7c38 bytes) 2024-09-14T07:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout:2111 writesame 0x62dd9a1 thru 0x62e7ebd data_size 0x1(0xa51d bytes) 2024-09-14T07:12:24.399 INFO:teuthology.orchestra.run.smithi071.stdout:2112 read 0x2788391 thru 0x278f41f (0x708f bytes) 2024-09-14T07:12:24.407 INFO:teuthology.orchestra.run.smithi071.stdout:2113 trunc from 0x6d6bf7a to 0xd42b60b 2024-09-14T07:12:24.412 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.413 INFO:teuthology.orchestra.run.smithi071.stdout:2117 write 0xa367aaf thru 0xa37078d (0x8cdf bytes) 2024-09-14T07:12:24.415 INFO:teuthology.orchestra.run.smithi071.stdout:2118 write 0xc8e1043 thru 0xc8e7349 (0x6307 bytes) 2024-09-14T07:12:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:2119 punch from 0x451141b to 0x45131e5, (0x1dca bytes) 2024-09-14T07:12:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:2120 write 0xbabbd thru 0xbf313 (0x4757 bytes) 2024-09-14T07:12:24.427 INFO:teuthology.orchestra.run.smithi071.stdout:2121 writesame 0xe06a77b thru 0xe06ddf9 data_size 0x1(0x367f bytes) 2024-09-14T07:12:24.429 INFO:teuthology.orchestra.run.smithi071.stdout:2122 trunc from 0xe06ddfa to 0xc0dcb31 2024-09-14T07:12:24.435 INFO:teuthology.orchestra.run.smithi071.stdout:2123 write 0x4e6a8d7 thru 0x4e76860 (0xbf8a bytes) 2024-09-14T07:12:24.436 INFO:teuthology.orchestra.run.smithi071.stdout:2124 read 0x72449a3 thru 0x724f92d (0xaf8b bytes) 2024-09-14T07:12:24.437 INFO:teuthology.orchestra.run.smithi071.stdout:2125 write 0xbedf74b thru 0xbee5c08 (0x64be bytes) 2024-09-14T07:12:24.440 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.440 INFO:teuthology.orchestra.run.smithi071.stdout:2131 read 0x37f0555 thru 0x37f7d14 (0x77c0 bytes) 2024-09-14T07:12:24.442 INFO:teuthology.orchestra.run.smithi071.stdout:2132 trunc from 0xc0dcb31 to 0x9f1cd35 2024-09-14T07:12:24.443 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.443 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.452 INFO:teuthology.orchestra.run.smithi071.stdout:2133 writesame 0x4c4f74 thru 0x4cfa12 data_size 0x1(0xaa9f bytes) 2024-09-14T07:12:24.452 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:24.451+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:24.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:24.473 INFO:teuthology.orchestra.run.smithi071.stdout:2135 read 0x74e9d92 thru 0x74f5862 (0xbad1 bytes) 2024-09-14T07:12:24.474 INFO:teuthology.orchestra.run.smithi071.stdout:2137 read 0x337fc02 thru 0x3387780 (0x7b7f bytes) 2024-09-14T07:12:24.474 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.474 INFO:teuthology.orchestra.run.smithi071.stdout:2139 writesame 0x8672c0e thru 0x8682110 data_size 0x1(0xf503 bytes) 2024-09-14T07:12:24.505 INFO:teuthology.orchestra.run.smithi071.stdout:2141 read 0x8b11f7d thru 0x8b16c23 (0x4ca7 bytes) 2024-09-14T07:12:24.516 INFO:teuthology.orchestra.run.smithi071.stdout:2142 trunc from 0x9f1cd35 to 0x1239511 2024-09-14T07:12:24.537 INFO:teuthology.orchestra.run.smithi071.stdout:2143 write 0x63b5f81 thru 0x63ba847 (0x48c7 bytes) 2024-09-14T07:12:24.540 INFO:teuthology.orchestra.run.smithi071.stdout:2144 read 0x1d772e1 thru 0x1d85d1e (0xea3e bytes) 2024-09-14T07:12:24.543 INFO:teuthology.orchestra.run.smithi071.stdout:2146 trunc from 0x63ba848 to 0x8426a80 2024-09-14T07:12:24.549 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.549 INFO:teuthology.orchestra.run.smithi071.stdout:2150 punch from 0x804ca0f to 0x805471d, (0x7d0e bytes) 2024-09-14T07:12:24.549 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.549 INFO:teuthology.orchestra.run.smithi071.stdout:2152 writesame 0x5878c9 thru 0x5928d1 data_size 0x1(0xb009 bytes) 2024-09-14T07:12:24.553 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:24.552+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:24.569 INFO:teuthology.orchestra.run.smithi071.stdout:2153 read 0x6f37667 thru 0x6f37c37 (0x5d1 bytes) 2024-09-14T07:12:24.577 INFO:teuthology.orchestra.run.smithi071.stdout:2154 write 0xa85ed03 thru 0xa863806 (0x4b04 bytes) 2024-09-14T07:12:24.580 INFO:teuthology.orchestra.run.smithi071.stdout:2155 write 0x8e1f6dd thru 0x8e1ffca (0x8ee bytes) 2024-09-14T07:12:24.582 INFO:teuthology.orchestra.run.smithi071.stdout:2157 write 0xd1b9e3 thru 0xd27df9 (0xc417 bytes) 2024-09-14T07:12:24.584 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.584 INFO:teuthology.orchestra.run.smithi071.stdout:2159 read 0x76cd859 thru 0x76cfb12 (0x22ba bytes) 2024-09-14T07:12:24.584 INFO:teuthology.orchestra.run.smithi071.stdout:2161 write 0x218555e thru 0x219036a (0xae0d bytes) 2024-09-14T07:12:24.586 INFO:teuthology.orchestra.run.smithi071.stdout:2162 writesame 0x962a7ed thru 0x962bf4b data_size 0x1(0x175f bytes) 2024-09-14T07:12:24.590 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.590 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.592 INFO:teuthology.orchestra.run.smithi071.stdout:2163 trunc from 0xa863807 to 0xd3c1032 2024-09-14T07:12:24.597 INFO:teuthology.orchestra.run.smithi071.stdout:2165 punch from 0x99a5884 to 0x99af47b, (0x9bf7 bytes) 2024-09-14T07:12:24.597 INFO:teuthology.orchestra.run.smithi071.stdout:2166 writesame 0xd768d7 thru 0xd76cdc data_size 0x5(0x406 bytes) 2024-09-14T07:12:24.598 INFO:teuthology.orchestra.run.smithi071.stdout:2167 punch from 0x9ae8f4d to 0x9af1746, (0x87f9 bytes) 2024-09-14T07:12:24.598 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.599 INFO:teuthology.orchestra.run.smithi071.stdout:2169 writesame 0x165f949 thru 0x1660a85 data_size 0x1(0x113d bytes) 2024-09-14T07:12:24.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:24.602 INFO:teuthology.orchestra.run.smithi071.stdout:2170 punch from 0x7075146 to 0x7075522, (0x3dc bytes) 2024-09-14T07:12:24.602 INFO:teuthology.orchestra.run.smithi071.stdout:2172 read 0x4574777 thru 0x457bdf6 (0x7680 bytes) 2024-09-14T07:12:24.602 INFO:teuthology.orchestra.run.smithi071.stdout:2173 write 0x2a47e4 thru 0x2a8284 (0x3aa1 bytes) 2024-09-14T07:12:24.602 INFO:teuthology.orchestra.run.smithi071.stdout:2174 writesame 0x5f8ea20 thru 0x5f98d8d data_size 0x1(0xa36e bytes) 2024-09-14T07:12:24.623 INFO:teuthology.orchestra.run.smithi071.stdout:2175 writesame 0x22341bb thru 0x2241e24 data_size 0x2(0xdc6a bytes) 2024-09-14T07:12:24.636 INFO:teuthology.orchestra.run.smithi071.stdout:2176 trunc from 0xd3c1032 to 0xedc8c63 2024-09-14T07:12:24.641 INFO:teuthology.orchestra.run.smithi071.stdout:2177 punch from 0x5cc9612 to 0x5cd7d2b, (0xe719 bytes) 2024-09-14T07:12:24.641 INFO:teuthology.orchestra.run.smithi071.stdout:2178 read 0x3831e25 thru 0x3832cff (0xedb bytes) 2024-09-14T07:12:24.654 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:24.652+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:24.654 INFO:teuthology.orchestra.run.smithi071.stdout:2179 trunc from 0xedc8c63 to 0x357060d 2024-09-14T07:12:24.689 INFO:teuthology.orchestra.run.smithi071.stdout:2181 write 0xea97f61 thru 0xeaa0850 (0x88f0 bytes) 2024-09-14T07:12:24.692 INFO:teuthology.orchestra.run.smithi071.stdout:2183 read 0x48750bc thru 0x48755a9 (0x4ee bytes) 2024-09-14T07:12:24.692 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.703 INFO:teuthology.orchestra.run.smithi071.stdout:2187 trunc from 0xeaa0851 to 0x51cd005 2024-09-14T07:12:24.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:24.716 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.716 INFO:teuthology.orchestra.run.smithi071.stdout:2189 writesame 0x47e61fb thru 0x47e6b30 data_size 0x9(0x936 bytes) 2024-09-14T07:12:24.721 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.721 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.729 INFO:teuthology.orchestra.run.smithi071.stdout:2190 trunc from 0x51cd005 to 0xc9715bb 2024-09-14T07:12:24.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:24.737 INFO:teuthology.orchestra.run.smithi071.stdout:2191 writesame 0x422d196 thru 0x423118a data_size 0x1(0x3ff5 bytes) 2024-09-14T07:12:24.747 INFO:teuthology.orchestra.run.smithi071.stdout:2192 trunc from 0xc9715bb to 0xce22300 2024-09-14T07:12:24.755 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:24.754+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:24.760 INFO:teuthology.orchestra.run.smithi071.stdout:2193 write 0xe8afd02 thru 0xe8b2d4b (0x304a bytes) 2024-09-14T07:12:24.766 INFO:teuthology.orchestra.run.smithi071.stdout:2197 trunc from 0xe8b2d4c to 0xbf697b0 2024-09-14T07:12:24.775 INFO:teuthology.orchestra.run.smithi071.stdout:2200 punch from 0x261d32e to 0x26288a9, (0xb57b bytes) 2024-09-14T07:12:24.775 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:24.776 INFO:teuthology.orchestra.run.smithi071.stdout:2204 read 0x7482597 thru 0x748669e (0x4108 bytes) 2024-09-14T07:12:24.776 INFO:teuthology.orchestra.run.smithi071.stdout:2207 writesame 0x97d9757 thru 0x97dc56c data_size 0x11(0x2e16 bytes) 2024-09-14T07:12:24.778 INFO:teuthology.orchestra.run.smithi071.stdout:2208 writesame 0x2bfcacf thru 0x2c012f1 data_size 0x1(0x4823 bytes) 2024-09-14T07:12:24.785 INFO:teuthology.orchestra.run.smithi071.stdout:2209 write 0x76448d1 thru 0x7647cc7 (0x33f7 bytes) 2024-09-14T07:12:24.789 INFO:teuthology.orchestra.run.smithi071.stdout:2210 punch from 0x1f2acc8 to 0x1f385c8, (0xd900 bytes) 2024-09-14T07:12:24.789 INFO:teuthology.orchestra.run.smithi071.stdout:2211 clone 19 order 22 su 131072 sc 15 2024-09-14T07:12:24.847 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:24.847 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:24.855 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:24.854+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:24.859 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:24.859 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:24.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:24.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:24.869 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:24.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:24.883 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:24.901 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:24.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:24.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:24.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:24.953 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:24.956 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:24.955+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:24.957 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:24.957 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:24.994 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-14T07:12:24.995 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:24.995 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:24.996 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:24.996 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:25.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:25.092 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:25.091+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:25.155 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:25.155 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:25.157 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:25.156+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:25.158 INFO:teuthology.orchestra.run.smithi071.stdout:2212 write 0xe054112 thru 0xe062b94 (0xea83 bytes) 2024-09-14T07:12:25.162 INFO:teuthology.orchestra.run.smithi071.stdout:2216 read 0xc7b327 thru 0xc7b6c3 (0x39d bytes) 2024-09-14T07:12:25.162 INFO:teuthology.orchestra.run.smithi071.stdout:2217 punch from 0x78e7c6c to 0x78eaf51, (0x32e5 bytes) 2024-09-14T07:12:25.163 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:25.168 INFO:teuthology.orchestra.run.smithi071.stdout:2220 trunc from 0xe062b95 to 0x979603d 2024-09-14T07:12:25.212 INFO:teuthology.orchestra.run.smithi071.stdout:2221 trunc from 0x979603d to 0x31fc9a3 2024-09-14T07:12:25.259 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:25.258+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:25.282 INFO:teuthology.orchestra.run.smithi071.stdout:2222 write 0x8ae4bfa thru 0x8aef051 (0xa458 bytes) 2024-09-14T07:12:25.284 INFO:teuthology.orchestra.run.smithi071.stdout:2223 read 0x75ccb1e thru 0x75d882d (0xbd10 bytes) 2024-09-14T07:12:25.285 INFO:teuthology.orchestra.run.smithi071.stdout:2224 read 0x80b93b thru 0x815f8f (0xa655 bytes) 2024-09-14T07:12:25.285 INFO:teuthology.orchestra.run.smithi071.stdout:2225 write 0x3b43355 thru 0x3b4f0e3 (0xbd8f bytes) 2024-09-14T07:12:25.294 INFO:teuthology.orchestra.run.smithi071.stdout:2226 write 0xb328d6a thru 0xb32f28d (0x6524 bytes) 2024-09-14T07:12:25.295 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7823 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'32, mlcod=32'30)", 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.561371574999999, 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020025759999999998, 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732726+0000", 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6799999999999999e-07 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732731+0000", 2024-09-14T07:12:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6119999999999998e-06 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732742+0000", 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.093e-05 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732748+0000", 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4990000000000002e-06 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732790+0000", 2024-09-14T07:12:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531000000000003e-05 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732803+0000", 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3135999999999999e-05 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734693+0000", 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889967 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734727+0000", 2024-09-14T07:12:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4032999999999998e-05 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7838 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'34, mlcod=34'32)", 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.549840552999999, 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00194644, 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744256+0000", 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744257+0000", 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0100000000000004e-07 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744263+0000", 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2779999999999999e-06 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744276+0000", 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3335e-05 2024-09-14T07:12:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744283+0000", 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8750000000000002e-06 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744328+0000", 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5000999999999998e-05 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.744348+0000", 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0239000000000001e-05 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746170+0000", 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018221859999999999 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.746202+0000", 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1724999999999999e-05 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7864 3.9 e34/23 3:9662e057:::rbd_data.1182a7d91484.0000000000000022:head v 34'31, mlcod=32'28)", 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.533782383999998, 2024-09-14T07:12:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020061520000000002, 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760325+0000", 2024-09-14T07:12:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0907000000000001e-05 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760333+0000", 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2150000000000001e-06 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760348+0000", 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5026e-05 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760405+0000", 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6885999999999997e-05 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760426+0000", 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0265e-05 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762272+0000", 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001846349 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762320+0000", 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8106000000000003e-05 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7866 3.4 e34/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:head v 34'37, mlcod=34'34)", 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.531857719000001, 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026596739999999999, 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762266+0000", 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7076e-05 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762280+0000", 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4004e-05 2024-09-14T07:12:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762288+0000", 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.678e-06 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762339+0000", 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0430000000000003e-05 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762357+0000", 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8850000000000001e-05 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764858+0000", 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004010000000002 2024-09-14T07:12:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764898+0000", 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0414000000000003e-05 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.527233121999998, 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.526134233000001, 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7905 3.4 e34/23 3:20b4893f:::rbd_data.1182a7d91484.0000000000000013:head v 34'39, mlcod=34'35)", 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.501944819999999, 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00219133, 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792152+0000", 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792161+0000", 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3809999999999999e-06 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792177+0000", 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5838e-05 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792185+0000", 2024-09-14T07:12:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9400000000000002e-06 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792248+0000", 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2928000000000005e-05 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792268+0000", 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0404999999999999e-05 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794300+0000", 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020316819999999999 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794343+0000", 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3183999999999999e-05 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.499291073999999, 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12482 3.0 e37/23 3:04a1ed04:::rbd_data.1182a59bd9ad.0000000000000028:head v 37'42, mlcod=37'39)", 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.212481066999999, 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028333389999999998, 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081616+0000", 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7300000000000005e-07 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081622+0000", 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081638+0000", 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6429000000000001e-05 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081646+0000", 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.622e-06 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081706+0000", 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9840000000000003e-05 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081724+0000", 2024-09-14T07:12:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8150000000000001e-05 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084410+0000", 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026862029999999999 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084449+0000", 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8342e-05 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.485997069, 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.485927655000001, 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.64554963, 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.4699583920000006, 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19777 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'87, mlcod=47'85)", 2024-09-14T07:12:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.839707+0000", 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.4543889780000008, 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001950755, 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839707+0000", 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839707+0000", 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839708+0000", 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839712+0000", 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4150000000000001e-06 2024-09-14T07:12:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839721+0000", 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9230000000000008e-06 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839727+0000", 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839777+0000", 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0142000000000002e-05 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.839794+0000", 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7172000000000001e-05 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.841630+0000", 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018360469999999999 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.841658+0000", 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8192999999999999e-05 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.179893496, 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:12:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:12:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.1758651980000003, 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:12:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:12:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.954866075, 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:12:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.9513482639999999, 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:12:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43971 3.4 e50/23 3:278d3374:::rbd_data.1182f9393092.0000000000000022:head v 50'120, mlcod=49'118)", 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.413931432, 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002152686, 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880166+0000", 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.437e-06 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880415+0000", 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024896599999999999 2024-09-14T07:12:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880433+0000", 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7768999999999999e-05 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880442+0000", 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.312e-06 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880509+0000", 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6548e-05 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880532+0000", 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3351000000000001e-05 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.882279+0000", 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017470490000000001 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.882318+0000", 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8254000000000003e-05 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43989 3.9 e51/23 3:93226f4f:::rbd_data.1182f9393092.0000000000000076:head v 51'118, mlcod=49'115)", 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.4883964110000001, 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029103520000000002, 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805706+0000", 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3510000000000001e-06 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805722+0000", 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6087999999999999e-05 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805734+0000", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.259e-05 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805837+0000", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103168 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805855+0000", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8048000000000001e-05 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808571+0000", 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027152500000000002 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808610+0000", 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9530000000000003e-05 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:25.393 INFO:teuthology.orchestra.run.smithi071.stdout:2227 write 0x5ef63d5 thru 0x5f02ecc (0xcaf8 bytes) 2024-09-14T07:12:25.394 INFO:teuthology.orchestra.run.smithi071.stdout:2228 punch from 0xa75a6c2 to 0xa761f91, (0x78cf bytes) 2024-09-14T07:12:25.394 INFO:teuthology.orchestra.run.smithi071.stdout:2229 write 0xae56b03 thru 0xae65a91 (0xef8f bytes) 2024-09-14T07:12:25.394 INFO:teuthology.orchestra.run.smithi071.stdout:2230 writesame 0x71f718b thru 0x71f762c data_size 0x1(0x4a2 bytes) 2024-09-14T07:12:25.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2232 write 0xc98143a thru 0xc9873a3 (0x5f6a bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2234 trunc from 0xc9873a4 to 0x960430a 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2236 write 0x4bc7cad thru 0x4bc9a09 (0x1d5d bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2240 read 0x2875bcc thru 0x28771c6 (0x15fb bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2241 write 0x446b314 thru 0x44703fa (0x50e7 bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2242 writesame 0x241a4f3 thru 0x242a1b4 data_size 0x1(0xfcc2 bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2244 write 0xd6a21aa thru 0xd6aaf46 (0x8d9d bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:2245 write 0x84a9c4d thru 0x84b6664 (0xca18 bytes) 2024-09-14T07:12:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.397 INFO:teuthology.orchestra.run.smithi071.stdout:2247 read 0xd467ba4 thru 0xd470e49 (0x92a6 bytes) 2024-09-14T07:12:25.397 INFO:teuthology.orchestra.run.smithi071.stdout:2249 trunc from 0xd6aaf47 to 0xa7b9738 2024-09-14T07:12:25.397 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:25.392+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:25.400 INFO:teuthology.orchestra.run.smithi071.stdout:2250 write 0xe21eb95 thru 0xe220bde (0x204a bytes) 2024-09-14T07:12:25.418 INFO:teuthology.orchestra.run.smithi071.stdout:2251 trunc from 0xe220bdf to 0x3452e00 2024-09-14T07:12:25.434 INFO:teuthology.orchestra.run.smithi071.stdout:2252 trunc from 0x3452e00 to 0x1a2a108 2024-09-14T07:12:25.459 INFO:teuthology.orchestra.run.smithi071.stdout:2254 write 0xaf23198 thru 0xaf26c6a (0x3ad3 bytes) 2024-09-14T07:12:25.461 INFO:teuthology.orchestra.run.smithi071.stdout:2257 read 0x630fb56 thru 0x631dbee (0xe099 bytes) 2024-09-14T07:12:25.461 INFO:teuthology.orchestra.run.smithi071.stdout:2259 write 0x7151d76 thru 0x7157438 (0x56c3 bytes) 2024-09-14T07:12:25.463 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.463 INFO:teuthology.orchestra.run.smithi071.stdout:2264 read 0x2e4098 thru 0x2e8a7f (0x49e8 bytes) 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:2272 punch from 0x23c8887 to 0x23cac14, (0x238d bytes) 2024-09-14T07:12:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:2273 writesame 0x78b162c thru 0x78bdb14 data_size 0x9(0xc4e9 bytes) 2024-09-14T07:12:25.468 INFO:teuthology.orchestra.run.smithi071.stdout:2275 writesame 0x2a824b5 thru 0x2a8d45d data_size 0x1(0xafa9 bytes) 2024-09-14T07:12:25.490 INFO:teuthology.orchestra.run.smithi071.stdout:2276 write 0xa8fe975 thru 0xa904aec (0x6178 bytes) 2024-09-14T07:12:25.494 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.494 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.494 INFO:teuthology.orchestra.run.smithi071.stdout:2279 write 0xac0599e thru 0xac11907 (0xbf6a bytes) 2024-09-14T07:12:25.494 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:25.493+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:25.496 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.496 INFO:teuthology.orchestra.run.smithi071.stdout:2284 read 0x3c35059 thru 0x3c387d7 (0x377f bytes) 2024-09-14T07:12:25.496 INFO:teuthology.orchestra.run.smithi071.stdout:2285 write 0x614b8cb thru 0x614dc44 (0x237a bytes) 2024-09-14T07:12:25.498 INFO:teuthology.orchestra.run.smithi071.stdout:2286 read 0x9b0e692 thru 0x9b14b8c (0x64fb bytes) 2024-09-14T07:12:25.498 INFO:teuthology.orchestra.run.smithi071.stdout:2288 read 0x4db3e09 thru 0x4db890e (0x4b06 bytes) 2024-09-14T07:12:25.499 INFO:teuthology.orchestra.run.smithi071.stdout:2289 read 0xa6bcd31 thru 0xa6c288f (0x5b5f bytes) 2024-09-14T07:12:25.499 INFO:teuthology.orchestra.run.smithi071.stdout:2290 writesame 0x9c966a7 thru 0x9ca57bb data_size 0x1(0xf115 bytes) 2024-09-14T07:12:25.515 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:25.515 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:25.515 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:25.515 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:25.520 INFO:teuthology.orchestra.run.smithi071.stdout:2291 punch from 0x6456b1e to 0x646094e, (0x9e30 bytes) 2024-09-14T07:12:25.520 INFO:teuthology.orchestra.run.smithi071.stdout:2292 write 0x8b94f75 thru 0x8b95a27 (0xab3 bytes) 2024-09-14T07:12:25.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:25.524 INFO:teuthology.orchestra.run.smithi071.stdout:2294 trunc from 0xaf26c6b to 0x967d8b6 2024-09-14T07:12:25.530 INFO:teuthology.orchestra.run.smithi071.stdout:2296 read 0x3f78877 thru 0x3f7941e (0xba8 bytes) 2024-09-14T07:12:25.530 INFO:teuthology.orchestra.run.smithi071.stdout:2297 punch from 0x6cf0bf9 to 0x6cffc2d, (0xf034 bytes) 2024-09-14T07:12:25.530 INFO:teuthology.orchestra.run.smithi071.stdout:2298 write 0x14ca848 thru 0x14d7973 (0xd12c bytes) 2024-09-14T07:12:25.532 INFO:teuthology.orchestra.run.smithi071.stdout:2299 read 0x76835eb thru 0x7687021 (0x3a37 bytes) 2024-09-14T07:12:25.532 INFO:teuthology.orchestra.run.smithi071.stdout:2301 read 0x949adab thru 0x94aab3f (0xfd95 bytes) 2024-09-14T07:12:25.537 INFO:teuthology.orchestra.run.smithi071.stdout:2302 writesame 0xa8c3a56 thru 0xa8c432c data_size 0x1(0x8d7 bytes) 2024-09-14T07:12:25.542 INFO:teuthology.orchestra.run.smithi071.stdout:2303 writesame 0xa983bd5 thru 0xa987a9e data_size 0x39(0x3eca bytes) 2024-09-14T07:12:25.543 INFO:teuthology.orchestra.run.smithi071.stdout:2304 read 0x2fbaabe thru 0x2fbac2f (0x172 bytes) 2024-09-14T07:12:25.543 INFO:teuthology.orchestra.run.smithi071.stdout:2307 read 0x83c055c thru 0x83c6613 (0x60b8 bytes) 2024-09-14T07:12:25.543 INFO:teuthology.orchestra.run.smithi071.stdout:2308 write 0x43eab36 thru 0x43f214e (0x7619 bytes) 2024-09-14T07:12:25.546 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.546 INFO:teuthology.orchestra.run.smithi071.stdout:2310 write 0x73c299a thru 0x73c8774 (0x5ddb bytes) 2024-09-14T07:12:25.548 INFO:teuthology.orchestra.run.smithi071.stdout:2311 write 0x1254e15 thru 0x1257f3e (0x312a bytes) 2024-09-14T07:12:25.550 INFO:teuthology.orchestra.run.smithi071.stdout:2312 writesame 0x1be9c0d thru 0x1bf530f data_size 0x15(0xb703 bytes) 2024-09-14T07:12:25.561 INFO:teuthology.orchestra.run.smithi071.stdout:2314 write 0xe969330 thru 0xe972e73 (0x9b44 bytes) 2024-09-14T07:12:25.564 INFO:teuthology.orchestra.run.smithi071.stdout:2315 read 0xacfa878 thru 0xad03967 (0x90f0 bytes) 2024-09-14T07:12:25.564 INFO:teuthology.orchestra.run.smithi071.stdout:2316 read 0x9b27ae thru 0x9b9e16 (0x7669 bytes) 2024-09-14T07:12:25.564 INFO:teuthology.orchestra.run.smithi071.stdout:2317 writesame 0x8235100 thru 0x82427e2 data_size 0xb(0xd6e3 bytes) 2024-09-14T07:12:25.567 INFO:teuthology.orchestra.run.smithi071.stdout:2319 write 0x99668b6 thru 0x9970130 (0x987b bytes) 2024-09-14T07:12:25.569 INFO:teuthology.orchestra.run.smithi071.stdout:2320 read 0x797015b thru 0x7979211 (0x90b7 bytes) 2024-09-14T07:12:25.570 INFO:teuthology.orchestra.run.smithi071.stdout:2321 writesame 0x13610dd thru 0x136217e data_size 0x1(0x10a2 bytes) 2024-09-14T07:12:25.572 INFO:teuthology.orchestra.run.smithi071.stdout:2322 punch from 0x2e626d0 to 0x2e71b70, (0xf4a0 bytes) 2024-09-14T07:12:25.572 INFO:teuthology.orchestra.run.smithi071.stdout:2323 write 0xd4c993a thru 0xd4ce812 (0x4ed9 bytes) 2024-09-14T07:12:25.573 INFO:teuthology.orchestra.run.smithi071.stdout:2325 write 0xe08e3f9 thru 0xe093a0f (0x5617 bytes) 2024-09-14T07:12:25.576 INFO:teuthology.orchestra.run.smithi071.stdout:2326 write 0xacafe46 thru 0xacb31a8 (0x3363 bytes) 2024-09-14T07:12:25.577 INFO:teuthology.orchestra.run.smithi071.stdout:2327 write 0xa736eb6 thru 0xa744234 (0xd37f bytes) 2024-09-14T07:12:25.579 INFO:teuthology.orchestra.run.smithi071.stdout:2328 read 0xda1f1bf thru 0xda2836a (0x91ac bytes) 2024-09-14T07:12:25.579 INFO:teuthology.orchestra.run.smithi071.stdout:2330 punch from 0x51013a4 to 0x510d892, (0xc4ee bytes) 2024-09-14T07:12:25.589 INFO:teuthology.orchestra.run.smithi071.stdout:2332 trunc from 0xe972e74 to 0x65beed9 2024-09-14T07:12:25.595 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:25.593+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:25.609 INFO:teuthology.orchestra.run.smithi071.stdout:2333 writesame 0xa8f5761 thru 0xa903f31 data_size 0x37(0xe7d1 bytes) 2024-09-14T07:12:25.609 INFO:teuthology.orchestra.run.smithi071.stdout:2334 punch from 0x449ed30 to 0x44a92a3, (0xa573 bytes) 2024-09-14T07:12:25.609 INFO:teuthology.orchestra.run.smithi071.stdout:2336 read 0x6030c8c thru 0x603bc50 (0xafc5 bytes) 2024-09-14T07:12:25.609 INFO:teuthology.orchestra.run.smithi071.stdout:2340 writesame 0xa2dfe95 thru 0xa2e0fb6 data_size 0x33(0x1122 bytes) 2024-09-14T07:12:25.612 INFO:teuthology.orchestra.run.smithi071.stdout:2341 read 0x217ca79 thru 0x218aa57 (0xdfdf bytes) 2024-09-14T07:12:25.612 INFO:teuthology.orchestra.run.smithi071.stdout:2342 read 0x15ccdb4 thru 0x15d8aaa (0xbcf7 bytes) 2024-09-14T07:12:25.620 INFO:teuthology.orchestra.run.smithi071.stdout:2343 write 0xc85aeb4 thru 0xc86980c (0xe959 bytes) 2024-09-14T07:12:25.624 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.624 INFO:teuthology.orchestra.run.smithi071.stdout:2345 write 0x82bd044 thru 0x82c27d5 (0x5792 bytes) 2024-09-14T07:12:25.633 INFO:teuthology.orchestra.run.smithi071.stdout:2346 write 0xe5e6dc8 thru 0xe5ece58 (0x6091 bytes) 2024-09-14T07:12:25.636 INFO:teuthology.orchestra.run.smithi071.stdout:2347 write 0x51e61f1 thru 0x51f1dbd (0xbbcd bytes) 2024-09-14T07:12:25.638 INFO:teuthology.orchestra.run.smithi071.stdout:2348 write 0xd3fe7c9 thru 0xd4042c6 (0x5afe bytes) 2024-09-14T07:12:25.644 INFO:teuthology.orchestra.run.smithi071.stdout:2349 write 0xfa042e thru 0xfae9a2 (0xe575 bytes) 2024-09-14T07:12:25.645 INFO:teuthology.orchestra.run.smithi071.stdout:2350 write 0x47a545d thru 0x47a68ee (0x1492 bytes) 2024-09-14T07:12:25.647 INFO:teuthology.orchestra.run.smithi071.stdout:2351 punch from 0x651a080 to 0x652217b, (0x80fb bytes) 2024-09-14T07:12:25.647 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.647 INFO:teuthology.orchestra.run.smithi071.stdout:2353 write 0x23f88ad thru 0x2401c36 (0x938a bytes) 2024-09-14T07:12:25.648 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:25.648 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:25.649 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.654 INFO:teuthology.orchestra.run.smithi071.stdout:2356 write 0xedd3eab thru 0xeddffd9 (0xc12f bytes) 2024-09-14T07:12:25.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:25.672 INFO:teuthology.orchestra.run.smithi071.stdout:2357 trunc from 0xeddffda to 0xa84953 2024-09-14T07:12:25.696 INFO:teuthology.orchestra.run.smithi071.stdout:2358 writesame 0x35eff92 thru 0x35fd2fc data_size 0x1(0xd36b bytes) 2024-09-14T07:12:25.696 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:25.695+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:25.705 INFO:teuthology.orchestra.run.smithi071.stdout:2360 write 0x616349d thru 0x6167119 (0x3c7d bytes) 2024-09-14T07:12:25.709 INFO:teuthology.orchestra.run.smithi071.stdout:2361 trunc from 0x616711a to 0x5001098 2024-09-14T07:12:25.727 INFO:teuthology.orchestra.run.smithi071.stdout:2362 write 0xb30c1eb thru 0xb30f1b2 (0x2fc8 bytes) 2024-09-14T07:12:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:2363 trunc from 0xb30f1b3 to 0x4be8b61 2024-09-14T07:12:25.748 INFO:teuthology.orchestra.run.smithi071.stdout:2364 read 0x1ce6bad thru 0x1ceecdc (0x8130 bytes) 2024-09-14T07:12:25.748 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.748 INFO:teuthology.orchestra.run.smithi071.stdout:2368 read 0x776f15 thru 0x785a6c (0xeb58 bytes) 2024-09-14T07:12:25.755 INFO:teuthology.orchestra.run.smithi071.stdout:2369 trunc from 0x4be8b61 to 0xa2e6121 2024-09-14T07:12:25.760 INFO:teuthology.orchestra.run.smithi071.stdout:2370 flatten 2024-09-14T07:12:25.765 INFO:teuthology.orchestra.run.smithi071.stdout:2371 read 0xfcb653 thru 0xfd15c5 (0x5f73 bytes) 2024-09-14T07:12:25.766 INFO:teuthology.orchestra.run.smithi071.stdout:2372 punch from 0x1a33508 to 0x1a33cc0, (0x7b8 bytes) 2024-09-14T07:12:25.766 INFO:teuthology.orchestra.run.smithi071.stdout:2374 writesame 0x1a5c673 thru 0x1a600e8 data_size 0x7(0x3a76 bytes) 2024-09-14T07:12:25.768 INFO:teuthology.orchestra.run.smithi071.stdout:2375 writesame 0x9a9f853 thru 0x9aaeabb data_size 0x1(0xf269 bytes) 2024-09-14T07:12:25.788 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8180223800000004, 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:12:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8179900280000005, 2024-09-14T07:12:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:12:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8179053770000007, 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8178800180000003, 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:12:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8178473099999994, 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:12:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8178151860000007, 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:12:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.817783768, 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:12:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8177597989999992, 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:12:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:12:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8177401010000001, 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:12:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8177261589999993, 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:12:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:12:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:12:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8177149289999992, 2024-09-14T07:12:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:12:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8177038010000004, 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:12:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176926390000006, 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176819280000007, 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:12:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176722210000005, 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:12:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176626569999996, 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:12:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176533209999999, 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:12:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:12:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176431290000004, 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:12:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:12:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8176227520000001, 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:12:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:12:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8175767080000007, 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:12:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:12:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:25.881 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:25.882 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:25.882 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:25.882 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T07:12:25.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T07:12:25.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:12:25.884 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:25.881+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:25.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:25.886 INFO:teuthology.orchestra.run.smithi071.stdout:2378 write 0x5196494 thru 0x51a0f15 (0xaa82 bytes) 2024-09-14T07:12:25.886 INFO:teuthology.orchestra.run.smithi071.stdout:2380 punch from 0x3a6f1da to 0x3a7c8e4, (0xd70a bytes) 2024-09-14T07:12:25.886 INFO:teuthology.orchestra.run.smithi071.stdout:2381 read 0x6d4d2bb thru 0x6d55a3a (0x8780 bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2382 writesame 0xe9ea2d9 thru 0xe9f1dcc data_size 0xc(0x7af4 bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2383 write 0xf7b9e4 thru 0xf82be8 (0x7205 bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2384 writesame 0x2bbc746 thru 0x2bc60d5 data_size 0xa8(0x9990 bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2386 trunc from 0xe9f1dcd to 0x4f1f05b 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2388 punch from 0x1e9c6f6 to 0x1e9cf91, (0x89b bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2389 trunc from 0x4f1f05b to 0xaf95154 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2392 writesame 0x81b590e thru 0x81b89c6 data_size 0x1(0x30b9 bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2394 write 0x7873669 thru 0x787cc6b (0x9603 bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:2395 writesame 0x6252631 thru 0x625c37c data_size 0x2(0x9d4c bytes) 2024-09-14T07:12:25.887 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.888 INFO:teuthology.orchestra.run.smithi071.stdout:2397 read 0xa49d9fd thru 0xa4aaefd (0xd501 bytes) 2024-09-14T07:12:25.888 INFO:teuthology.orchestra.run.smithi071.stdout:2401 writesame 0x13b66a4 thru 0x13c1cfa data_size 0x1(0xb657 bytes) 2024-09-14T07:12:25.890 INFO:teuthology.orchestra.run.smithi071.stdout:2402 write 0xc927d68 thru 0xc933b2e (0xbdc7 bytes) 2024-09-14T07:12:25.893 INFO:teuthology.orchestra.run.smithi071.stdout:2403 write 0x905dc46 thru 0x90610a5 (0x3460 bytes) 2024-09-14T07:12:25.896 INFO:teuthology.orchestra.run.smithi071.stdout:2404 punch from 0x2af71d6 to 0x2af9f8a, (0x2db4 bytes) 2024-09-14T07:12:25.896 INFO:teuthology.orchestra.run.smithi071.stdout:2405 read 0x2bc159a thru 0x2bc1f6d (0x9d4 bytes) 2024-09-14T07:12:25.896 INFO:teuthology.orchestra.run.smithi071.stdout:2407 write 0x833d1eb thru 0x833e8b0 (0x16c6 bytes) 2024-09-14T07:12:25.898 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.910 INFO:teuthology.orchestra.run.smithi071.stdout:2410 trunc from 0xc933b2f to 0x25dbdb2 2024-09-14T07:12:25.924 INFO:teuthology.orchestra.run.smithi071.stdout:2411 read 0x25901e9 thru 0x259a915 (0xa72d bytes) 2024-09-14T07:12:25.924 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.942 INFO:teuthology.orchestra.run.smithi071.stdout:2413 write 0xb6c0c91 thru 0xb6ce642 (0xd9b2 bytes) 2024-09-14T07:12:25.944 INFO:teuthology.orchestra.run.smithi071.stdout:2414 punch from 0x260c042 to 0x261ab83, (0xeb41 bytes) 2024-09-14T07:12:25.953 INFO:teuthology.orchestra.run.smithi071.stdout:2415 writesame 0xd7ceeb6 thru 0xd7de5f2 data_size 0x1(0xf73d bytes) 2024-09-14T07:12:25.953 INFO:teuthology.orchestra.run.smithi071.stdout:2416 write 0x24e7f48 thru 0x24f1fd9 (0xa092 bytes) 2024-09-14T07:12:25.967 INFO:teuthology.orchestra.run.smithi071.stdout:2419 trunc from 0xd7de5f3 to 0x2ba1a7f 2024-09-14T07:12:25.982 INFO:teuthology.orchestra.run.smithi071.stdout:2420 read 0x166eb2d thru 0x1672982 (0x3e56 bytes) 2024-09-14T07:12:25.983 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:25.981+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:25.987 INFO:teuthology.orchestra.run.smithi071.stdout:2421 write 0x391e528 thru 0x39245e6 (0x60bf bytes) 2024-09-14T07:12:25.993 INFO:teuthology.orchestra.run.smithi071.stdout:2422 trunc from 0x39245e7 to 0x7247e6c 2024-09-14T07:12:25.995 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:25.995 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:25.995 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:25.995 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:25.998 INFO:teuthology.orchestra.run.smithi071.stdout:2423 punch from 0x3241d69 to 0x3247401, (0x5698 bytes) 2024-09-14T07:12:25.998 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:25.998 INFO:teuthology.orchestra.run.smithi071.stdout:2425 read 0x194c717 thru 0x1951d06 (0x55f0 bytes) 2024-09-14T07:12:26.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:26.004 INFO:teuthology.orchestra.run.smithi071.stdout:2426 trunc from 0x7247e6c to 0x31ce265 2024-09-14T07:12:26.013 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.030 INFO:teuthology.orchestra.run.smithi071.stdout:2431 writesame 0xc2ff583 thru 0xc306d29 data_size 0x1(0x77a7 bytes) 2024-09-14T07:12:26.041 INFO:teuthology.orchestra.run.smithi071.stdout:2432 trunc from 0xc306d2a to 0x32d7fe1 2024-09-14T07:12:26.050 INFO:teuthology.orchestra.run.smithi071.stdout:2434 writesame 0x36ff05 thru 0x375d3c data_size 0x78(0x5e38 bytes) 2024-09-14T07:12:26.052 INFO:teuthology.orchestra.run.smithi071.stdout:2436 writesame 0x20c70f0 thru 0x20c9d0b data_size 0x6(0x2c1c bytes) 2024-09-14T07:12:26.053 INFO:teuthology.orchestra.run.smithi071.stdout:2437 read 0x1cde820 thru 0x1cedb8a (0xf36b bytes) 2024-09-14T07:12:26.053 INFO:teuthology.orchestra.run.smithi071.stdout:2439 punch from 0x3290759 to 0x329c30c, (0xbbb3 bytes) 2024-09-14T07:12:26.053 INFO:teuthology.orchestra.run.smithi071.stdout:2441 write 0x2c747ac thru 0x2c7d479 (0x8cce bytes) 2024-09-14T07:12:26.074 INFO:teuthology.orchestra.run.smithi071.stdout:2442 write 0xedb4d64 thru 0xedbf9dc (0xac79 bytes) 2024-09-14T07:12:26.077 INFO:teuthology.orchestra.run.smithi071.stdout:2443 read 0xe4f54a thru 0xe5c923 (0xd3da bytes) 2024-09-14T07:12:26.077 INFO:teuthology.orchestra.run.smithi071.stdout:2445 read 0xdcebf50 thru 0xdcf41d2 (0x8283 bytes) 2024-09-14T07:12:26.077 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.077 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.078 INFO:teuthology.orchestra.run.smithi071.stdout:2448 write 0x7fa2765 thru 0x7fa76a4 (0x4f40 bytes) 2024-09-14T07:12:26.079 INFO:teuthology.orchestra.run.smithi071.stdout:2449 read 0x80dc534 thru 0x80ec226 (0xfcf3 bytes) 2024-09-14T07:12:26.079 INFO:teuthology.orchestra.run.smithi071.stdout:2450 write 0x7a441ad thru 0x7a44a17 (0x86b bytes) 2024-09-14T07:12:26.081 INFO:teuthology.orchestra.run.smithi071.stdout:2451 write 0x30e9dff thru 0x30f7df7 (0xdff9 bytes) 2024-09-14T07:12:26.083 INFO:teuthology.orchestra.run.smithi071.stdout:2455 read 0xed2811b thru 0xed2f9c5 (0x78ab bytes) 2024-09-14T07:12:26.083 INFO:teuthology.orchestra.run.smithi071.stdout:2456 punch from 0x5be30a to 0x5caaa7, (0xc79d bytes) 2024-09-14T07:12:26.083 INFO:teuthology.orchestra.run.smithi071.stdout:2457 write 0x74c282b thru 0x74c4989 (0x215f bytes) 2024-09-14T07:12:26.084 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:26.082+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:26.097 INFO:teuthology.orchestra.run.smithi071.stdout:2458 trunc from 0xedbf9dd to 0x70d4018 2024-09-14T07:12:26.106 INFO:teuthology.orchestra.run.smithi071.stdout:2459 write 0xeec525 thru 0xef94bb (0xcf97 bytes) 2024-09-14T07:12:26.108 INFO:teuthology.orchestra.run.smithi071.stdout:2461 punch from 0x4f3a048 to 0x4f45e34, (0xbdec bytes) 2024-09-14T07:12:26.108 INFO:teuthology.orchestra.run.smithi071.stdout:2463 write 0x2cbc1da thru 0x2cca87c (0xe6a3 bytes) 2024-09-14T07:12:26.111 INFO:teuthology.orchestra.run.smithi071.stdout:2464 trunc from 0x70d4018 to 0x5b8b627 2024-09-14T07:12:26.117 INFO:teuthology.orchestra.run.smithi071.stdout:2467 punch from 0x3b3cea5 to 0x3b4bd99, (0xeef4 bytes) 2024-09-14T07:12:26.117 INFO:teuthology.orchestra.run.smithi071.stdout:2468 read 0x1478520 thru 0x147cca4 (0x4785 bytes) 2024-09-14T07:12:26.117 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.125 INFO:teuthology.orchestra.run.smithi071.stdout:2470 writesame 0x829a88b thru 0x82a7462 data_size 0x2c(0xcbd8 bytes) 2024-09-14T07:12:26.128 INFO:teuthology.orchestra.run.smithi071.stdout:2471 trunc from 0x82a7463 to 0x6414d92 2024-09-14T07:12:26.133 INFO:teuthology.orchestra.run.smithi071.stdout:2473 read 0x411e498 thru 0x4122640 (0x41a9 bytes) 2024-09-14T07:12:26.133 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.133 INFO:teuthology.orchestra.run.smithi071.stdout:2476 write 0x16fe53d thru 0x1704bec (0x66b0 bytes) 2024-09-14T07:12:26.144 INFO:teuthology.orchestra.run.smithi071.stdout:2477 write 0x9277373 thru 0x927a8ca (0x3558 bytes) 2024-09-14T07:12:26.145 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.145 INFO:teuthology.orchestra.run.smithi071.stdout:2479 read 0x50e96a9 thru 0x50eab58 (0x14b0 bytes) 2024-09-14T07:12:26.151 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:26.151 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:26.152 INFO:teuthology.orchestra.run.smithi071.stdout:2480 write 0xa2f98e4 thru 0xa30326d (0x998a bytes) 2024-09-14T07:12:26.155 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.157 INFO:teuthology.orchestra.run.smithi071.stdout:2482 trunc from 0xa30326e to 0x8169c8f 2024-09-14T07:12:26.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:26.164 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.176 INFO:teuthology.orchestra.run.smithi071.stdout:2484 writesame 0xc930599 thru 0xc931d8c data_size 0x7(0x17f4 bytes) 2024-09-14T07:12:26.177 INFO:teuthology.orchestra.run.smithi071.stdout:2485 trunc from 0xc931d8d to 0xbf7a952 2024-09-14T07:12:26.184 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:26.183+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:26.188 INFO:teuthology.orchestra.run.smithi071.stdout:2486 trunc from 0xbf7a952 to 0x81a80f8 2024-09-14T07:12:26.195 INFO:teuthology.orchestra.run.smithi071.stdout:2488 writesame 0x3cfb2d4 thru 0x3d034fb data_size 0xe(0x8228 bytes) 2024-09-14T07:12:26.198 INFO:teuthology.orchestra.run.smithi071.stdout:2490 punch from 0x544418d to 0x544c15a, (0x7fcd bytes) 2024-09-14T07:12:26.205 INFO:teuthology.orchestra.run.smithi071.stdout:2491 write 0x8bbdeed thru 0x8bc5dd0 (0x7ee4 bytes) 2024-09-14T07:12:26.208 INFO:teuthology.orchestra.run.smithi071.stdout:2492 punch from 0x64412f8 to 0x6447c2f, (0x6937 bytes) 2024-09-14T07:12:26.214 INFO:teuthology.orchestra.run.smithi071.stdout:2495 trunc from 0x8bc5dd1 to 0x43ec2ff 2024-09-14T07:12:26.224 INFO:teuthology.orchestra.run.smithi071.stdout:2496 read 0x29d594a thru 0x29de488 (0x8b3f bytes) 2024-09-14T07:12:26.224 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.225 INFO:teuthology.orchestra.run.smithi071.stdout:2498 write 0x2cb600e thru 0x2cc0eeb (0xaede bytes) 2024-09-14T07:12:26.226 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.226 INFO:teuthology.orchestra.run.smithi071.stdout:2501 read 0x2497d8c thru 0x24a667e (0xe8f3 bytes) 2024-09-14T07:12:26.227 INFO:teuthology.orchestra.run.smithi071.stdout:2502 punch from 0x18be25a to 0x18c5b5b, (0x7901 bytes) 2024-09-14T07:12:26.227 INFO:teuthology.orchestra.run.smithi071.stdout:2504 write 0x19bf643 thru 0x19cb8c4 (0xc282 bytes) 2024-09-14T07:12:26.240 INFO:teuthology.orchestra.run.smithi071.stdout:2505 trunc from 0x43ec2ff to 0xd5360aa 2024-09-14T07:12:26.253 INFO:teuthology.orchestra.run.smithi071.stdout:2506 trunc from 0xd5360aa to 0x78fe060 2024-09-14T07:12:26.263 INFO:teuthology.orchestra.run.smithi071.stdout:2507 trunc from 0x78fe060 to 0xaf3e19d 2024-09-14T07:12:26.268 INFO:teuthology.orchestra.run.smithi071.stdout:2508 trunc from 0xaf3e19d to 0xb282bc8 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20262 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4101805489999997, 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055198311999999999, 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20262 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858249+0000", 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9860000000000001e-06 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858256+0000", 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7460000000000003e-06 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858261+0000", 2024-09-14T07:12:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6840000000000001e-06 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913197+0000", 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054935171999999997 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913239+0000", 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2460999999999999e-05 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913445+0000", 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205894 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20264 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4101524619999992, 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055428349000000002, 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20264 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858282+0000", 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5640000000000002e-06 2024-09-14T07:12:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858289+0000", 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5839999999999997e-06 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858292+0000", 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913465+0000", 2024-09-14T07:12:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055172959000000001 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913524+0000", 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8489000000000002e-05 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913703+0000", 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000179354 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20266 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 565248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4101133689999994, 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055643262999999998, 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20266 2024-09-14T07:12:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7800000000000002e-07 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858316+0000", 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5570000000000001e-06 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858319+0000", 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5990000000000002e-06 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858322+0000", 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913743+0000", 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055421103999999999 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913797+0000", 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3492000000000002e-05 2024-09-14T07:12:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913957+0000", 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000160457 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20267 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 622592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4101020000000002, 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055883545, 2024-09-14T07:12:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20267 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9999999999999999e-07 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858326+0000", 2024-09-14T07:12:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3699999999999999e-07 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858330+0000", 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2969999999999999e-06 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858332+0000", 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6070000000000002e-06 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913986+0000", 2024-09-14T07:12:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055653310999999997 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914028+0000", 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2678e-05 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914209+0000", 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018041500000000001 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20270 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 679936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4100902709999996, 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056156692000000001, 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20270 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.39e-07 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858339+0000", 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.697e-06 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858345+0000", 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6690000000000003e-06 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858349+0000", 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4089999999999996e-06 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914250+0000", 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055901301 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914304+0000", 2024-09-14T07:12:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3331999999999997e-05 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914494+0000", 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018994500000000001 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20272 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 737280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4100741219999993, 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056423736000000002, 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20272 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858354+0000", 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1039999999999999e-06 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858359+0000", 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.899e-06 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858363+0000", 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2409999999999997e-06 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914526+0000", 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163006000000001 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914568+0000", 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1937000000000002e-05 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914777+0000", 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020833399999999999 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20277 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4100578949999996, 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056720242999999997, 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20277 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858370+0000", 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858372+0000", 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0229999999999999e-06 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858378+0000", 2024-09-14T07:12:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858383+0000", 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3489999999999999e-06 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914816+0000", 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056432942999999999 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914877+0000", 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0627000000000001e-05 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915089+0000", 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021294400000000001 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20280 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 851968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4100379519999997, 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056953472999999998, 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20280 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858390+0000", 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858392+0000", 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0899999999999999e-06 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858398+0000", 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9399999999999999e-06 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858403+0000", 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.074e-06 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915119+0000", 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056716338999999998 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915164+0000", 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4642999999999999e-05 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915343+0000", 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017900199999999999 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20281 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 569344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4100182879999998, 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057219575000000002, 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20281 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000003e-07 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858411+0000", 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9199999999999998e-06 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858417+0000", 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7729999999999996e-06 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858422+0000", 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7180000000000004e-06 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915373+0000", 2024-09-14T07:12:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056951193999999997 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915414+0000", 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1301000000000003e-05 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915628+0000", 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214095 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20282 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 909312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4099994070000008, 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057564303999999997, 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20282 2024-09-14T07:12:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858430+0000", 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858436+0000", 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7189999999999998e-06 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858440+0000", 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.651e-06 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915664+0000", 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057223759999999999 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915761+0000", 2024-09-14T07:12:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7372000000000002e-05 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915992+0000", 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023059099999999999 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20283 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 626688~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4099808239999998, 2024-09-14T07:12:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057833405999999997, 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20283 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858447+0000", 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2900000000000004e-07 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858449+0000", 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0020000000000001e-06 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858454+0000", 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3809999999999998e-06 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858459+0000", 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4889999999999997e-06 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916036+0000", 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057576910000000002 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916116+0000", 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0643999999999996e-05 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916280+0000", 2024-09-14T07:12:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000163451 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20284 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4099624629999994, 2024-09-14T07:12:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058094858999999999, 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20284 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858467+0000", 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.874e-06 2024-09-14T07:12:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858472+0000", 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5629999999999999e-06 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858477+0000", 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7910000000000004e-06 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916311+0000", 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057833757999999999 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916358+0000", 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7018999999999998e-05 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916560+0000", 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201454 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20285 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 684032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4099444860000006, 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058354537999999997, 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20285 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858485+0000", 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858490+0000", 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9729999999999997e-06 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858493+0000", 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6059999999999999e-06 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916588+0000", 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058094693000000003 2024-09-14T07:12:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916673+0000", 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4994000000000007e-05 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916837+0000", 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016414199999999999 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20286 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4099283979999999, 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058559422999999999, 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20286 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4099999999999999e-07 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858505+0000", 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6699999999999999e-06 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858511+0000", 2024-09-14T07:12:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2990000000000002e-06 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858516+0000", 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0379999999999999e-06 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916866+0000", 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058349491000000003 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916919+0000", 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3811999999999999e-05 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917058+0000", 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000138672 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20287 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 741376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4098856439999992, 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058806793000000003, 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20287 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858542+0000", 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5400000000000001e-07 2024-09-14T07:12:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858544+0000", 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.272e-06 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858550+0000", 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6980000000000003e-06 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858553+0000", 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9450000000000002e-06 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917093+0000", 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058540433000000003 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917189+0000", 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5525000000000004e-05 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917348+0000", 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159266 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20298 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 798720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4098687590000001, 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059061633000000002, 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20298 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858559+0000", 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7199999999999999e-07 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858560+0000", 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.641e-06 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858565+0000", 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1350000000000002e-06 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917378+0000", 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058810442999999997 2024-09-14T07:12:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917423+0000", 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4756999999999999e-05 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917620+0000", 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000197424 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20301 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 856064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4098564259999993, 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059306867999999999, 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20301 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858572+0000", 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.085e-06 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858575+0000", 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9289999999999998e-06 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858578+0000", 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917659+0000", 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059081394000000002 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917734+0000", 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5426000000000006e-05 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917878+0000", 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014318999999999999 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20303 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4098463280000004, 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059649109999999998, 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20303 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858582+0000", 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1800000000000004e-07 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858585+0000", 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.796e-06 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858588+0000", 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.044e-06 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917920+0000", 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059332480999999999 2024-09-14T07:12:26.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918010+0000", 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9884999999999997e-05 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918230+0000", 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021977300000000001 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20305 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 970752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4098366200000001, 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059866838999999998, 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20305 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858591+0000", 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858592+0000", 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858594+0000", 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7779999999999999e-06 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858597+0000", 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3609999999999999e-06 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918253+0000", 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059656265 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918296+0000", 2024-09-14T07:12:26.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2963999999999997e-05 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918457+0000", 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016128900000000001 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20307 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1028096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4098277209999992, 2024-09-14T07:12:26.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.060103704000000001, 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20307 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858600+0000", 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1199999999999999e-07 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858600+0000", 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9100000000000002e-07 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4819999999999999e-06 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858606+0000", 2024-09-14T07:12:26.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3709999999999998e-06 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918494+0000", 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059887915999999999 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918542+0000", 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7661000000000003e-05 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918703+0000", 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016117099999999999 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.363 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:26.364 INFO:teuthology.orchestra.run.smithi071.stdout:2509 read 0xacb4f96 thru 0xacbe33e (0x93a9 bytes) 2024-09-14T07:12:26.364 INFO:teuthology.orchestra.run.smithi071.stdout:2510 read 0x90dbdef thru 0x90e5d70 (0x9f82 bytes) 2024-09-14T07:12:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:12:26.365 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 54, 2024-09-14T07:12:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "589dc63d-1bfc-48bf-bb57-35804a598e44", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-09-14T07:11:21.848766+0000", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-09-14T07:12:24.807314+0000", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "last_up_change": "2024-09-14T07:12:02.678229+0000", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "last_in_change": "2024-09-14T07:11:24.880196+0000", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_num": 5799936, 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_set": [ 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "pglog_hardlimit", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "purged_snapdirs", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_deletes", 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "sortbitwise" 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_version": 5, 2024-09-14T07:12:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_snapshot": "", 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_max": 3, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "max_osd": 8, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "require_min_compat_client": "luminous", 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "min_compat_client": "jewel", 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "require_osd_release": "squid", 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_crimson": false, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "pools": [ 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 1, 2024-09-14T07:12:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": ".mgr", 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-09-14T07:11:36.356620+0000", 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "is_stretch_pool": false, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-09-14T07:12:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 1, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 1, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 1, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 1, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 1, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-09-14T07:12:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "18", 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-09-14T07:12:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-09-14T07:12:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-09-14T07:12:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "options": { 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_max": 32, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_min": 1 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": {} 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 6.9000000953674316, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 6.9000000953674316, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.28999999165534973, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 2, 2024-09-14T07:12:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 2, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 0.79687690734863281, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 2, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "rbd", 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-09-14T07:11:40.724021+0000", 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 8193, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-09-14T07:12:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "is_stretch_pool": false, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 8, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 8, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 8, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 8, 2024-09-14T07:12:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 8, 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "22", 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-09-14T07:12:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 2, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 22, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-09-14T07:12:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-09-14T07:12:26.378 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd": {} 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 3.4900000095367432, 2024-09-14T07:12:26.379 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 3.4900000095367432, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.86000001430511475, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 3, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 3, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 0.79687690734863281, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 3, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "pool_client.0", 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-09-14T07:11:50.672481+0000", 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 8193, 2024-09-14T07:12:26.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "is_stretch_pool": false, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 32, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 32, 2024-09-14T07:12:26.381 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 32, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 32, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 32, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "54", 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-09-14T07:12:26.382 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 21, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 54, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-09-14T07:12:26.383 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.384 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd": {} 2024-09-14T07:12:26.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.d), read balance score may not be reliable", 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 0, 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 0 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "osds": [ 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 0, 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "baa123cb-89ef-45b4-8952-ad69f57110ad", 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.386 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 50, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6818", 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6819", 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6821", 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6823", 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6829", 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6831", 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6825", 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6827", 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6819/2889617493", 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6823/2889617493", 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6831/2889617493", 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6827/2889617493", 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.391 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 1, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "d521eb0c-ea3e-46c6-8e5c-262df62043ab", 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.392 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 45, 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6802", 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6803", 2024-09-14T07:12:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6804", 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6805", 2024-09-14T07:12:26.394 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6808", 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.395 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6809", 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6806", 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6807", 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6803/3955072152", 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6805/3955072152", 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6809/3955072152", 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6807/3955072152", 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 2, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "089f22b2-6c41-4854-af61-bb916f617ef5", 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 33, 2024-09-14T07:12:26.398 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6820", 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6822", 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6824", 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6826", 2024-09-14T07:12:26.400 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6832", 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.401 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6833", 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6828", 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6830", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6822/3066758971", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6826/3066758971", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6833/3066758971", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6830/3066758971", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 3, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "5a8d365e-a098-4d07-9927-647c4fc0b3da", 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 0.3750152587890625, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.404 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 45, 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6810", 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6811", 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6812", 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6813", 2024-09-14T07:12:26.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6816", 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6817", 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6814", 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6815", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6811/1876512586", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6813/1876512586", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6817/1876512586", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6815/1876512586", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 4, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "13920f12-491b-4330-a5a2-fbf6c6f5242f", 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 45, 2024-09-14T07:12:26.410 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6816", 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6817", 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6818", 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6819", 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6822", 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6823", 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6820", 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6821", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6817/1898851107", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6819/1898851107", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6823/1898851107", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6821/1898851107", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 5, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "5c838ac4-0108-4981-bdee-8a6ae76e1f22", 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 0, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 23, 2024-09-14T07:12:26.416 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 33, 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6824", 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6825", 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6826", 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6827", 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6830", 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6831", 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6828", 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6829", 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:26.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6825/1385217108", 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6827/1385217108", 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1385217108", 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1385217108", 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "exists" 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.421 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 6, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "e9aacee6-d441-4987-addf-617339375ef0", 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 50, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.422 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6808", 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6809", 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6810", 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6811", 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6814", 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6815", 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6812", 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6813", 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6809/1465682528", 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6811/1465682528", 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6815/1465682528", 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6813/1465682528", 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 7, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "9e53e2c5-d137-442a-8ee8-9f8757a8e601", 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 0, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 33, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:26.428 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6800", 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6801", 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6802", 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6803", 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6806", 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6807", 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.431 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6804", 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6805", 2024-09-14T07:12:26.432 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6801/2849091451", 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6803/2849091451", 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6807/2849091451", 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6805/2849091451", 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.433 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_xinfo": [ 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 0, 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.746971+0000", 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.434 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 1, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.202992+0000", 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 2, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.435 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:32.026889+0000", 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 3, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.140575+0000", 2024-09-14T07:12:26.436 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 4, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.188928+0000", 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 5, 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.437 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.701967+0000", 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 33 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 6, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.438 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.242666+0000", 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 7, 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.149131+0000", 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.439 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap": [], 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap_items": [], 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap_primaries": [], 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_temp": [], 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_temp": [], 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklist": {}, 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "range_blocklist": {}, 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profiles": { 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "default": { 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "crush-failure-domain": "osd", 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "k": "2", 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "m": "1", 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin": "jerasure", 2024-09-14T07:12:26.440 INFO:teuthology.orchestra.run.smithi071.stdout: "technique": "reed_sol_van" 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps_queue": [], 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "new_removed_snaps": [], 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "new_purged_snaps": [], 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_node_flags": {}, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "device_class_flags": {}, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": { 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode_enabled": false, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_bucket_count": 0, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "degraded_stretch_mode": 0, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "recovering_stretch_mode": 0, 2024-09-14T07:12:26.441 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode_bucket": 0 2024-09-14T07:12:26.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:26.442 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:26.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:26.443 INFO:teuthology.orchestra.run.smithi071.stdout:2511 write 0xc4ce949 thru 0xc4d41fe (0x58b6 bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2512 write 0x303693c thru 0x30468bb (0xff80 bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2513 read 0xdc07c8 thru 0xdc1ccd (0x1506 bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2514 read 0x60bb684 thru 0x60bf33e (0x3cbb bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2516 read 0x3dd1b5d thru 0x3dd3417 (0x18bb bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2517 read 0xa1db727 thru 0xa1e5b39 (0xa413 bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2520 write 0x19a1bbc thru 0x19a6a1f (0x4e64 bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2521 read 0xbcaa345 thru 0xbcafded (0x5aa9 bytes) 2024-09-14T07:12:26.444 INFO:teuthology.orchestra.run.smithi071.stdout:2522 write 0xa2ee6c4 thru 0xa2fe1e9 (0xfb26 bytes) 2024-09-14T07:12:26.446 INFO:tasks.thrashosds.thrasher:j is {'epoch': 54, 'fsid': '589dc63d-1bfc-48bf-bb57-35804a598e44', 'created': '2024-09-14T07:11:21.848766+0000', 'modified': '2024-09-14T07:12:24.807314+0000', 'last_up_change': '2024-09-14T07:12:02.678229+0000', 'last_in_change': '2024-09-14T07:11:24.880196+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T07:11:36.356620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7968769073486328, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T07:11:40.724021+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.490000009536743, 'score_stable': 3.490000009536743, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.7968769073486328, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T07:11:50.672481+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 54, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.d), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'baa123cb-89ef-45b4-8952-ad69f57110ad', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6818', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6819', 'nonce': 2889617493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6821', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6823', 'nonce': 2889617493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6829', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6831', 'nonce': 2889617493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6825', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6827', 'nonce': 2889617493}]}, 'public_addr': '172.21.15.71:6819/2889617493', 'cluster_addr': '172.21.15.71:6823/2889617493', 'heartbeat_back_addr': '172.21.15.71:6831/2889617493', 'heartbeat_front_addr': '172.21.15.71:6827/2889617493', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd521eb0c-ea3e-46c6-8e5c-262df62043ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 3955072152}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6805', 'nonce': 3955072152}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6809', 'nonce': 3955072152}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6807', 'nonce': 3955072152}]}, 'public_addr': '172.21.15.71:6803/3955072152', 'cluster_addr': '172.21.15.71:6805/3955072152', 'heartbeat_back_addr': '172.21.15.71:6809/3955072152', 'heartbeat_front_addr': '172.21.15.71:6807/3955072152', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '089f22b2-6c41-4854-af61-bb916f617ef5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6820', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6822', 'nonce': 3066758971}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6824', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6826', 'nonce': 3066758971}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 3066758971}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6828', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6830', 'nonce': 3066758971}]}, 'public_addr': '172.21.15.71:6822/3066758971', 'cluster_addr': '172.21.15.71:6826/3066758971', 'heartbeat_back_addr': '172.21.15.71:6833/3066758971', 'heartbeat_front_addr': '172.21.15.71:6830/3066758971', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '5a8d365e-a098-4d07-9927-647c4fc0b3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3750152587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6811', 'nonce': 1876512586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6813', 'nonce': 1876512586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6816', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6817', 'nonce': 1876512586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6815', 'nonce': 1876512586}]}, 'public_addr': '172.21.15.71:6811/1876512586', 'cluster_addr': '172.21.15.71:6813/1876512586', 'heartbeat_back_addr': '172.21.15.71:6817/1876512586', 'heartbeat_front_addr': '172.21.15.71:6815/1876512586', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '13920f12-491b-4330-a5a2-fbf6c6f5242f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6816', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6817', 'nonce': 1898851107}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1898851107}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 1898851107}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6820', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 1898851107}]}, 'public_addr': '172.21.15.86:6817/1898851107', 'cluster_addr': '172.21.15.86:6819/1898851107', 'heartbeat_back_addr': '172.21.15.86:6823/1898851107', 'heartbeat_front_addr': '172.21.15.86:6821/1898851107', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5c838ac4-0108-4981-bdee-8a6ae76e1f22', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 33, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1385217108}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1385217108}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1385217108}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1385217108}]}, 'public_addr': '172.21.15.86:6825/1385217108', 'cluster_addr': '172.21.15.86:6827/1385217108', 'heartbeat_back_addr': '172.21.15.86:6831/1385217108', 'heartbeat_front_addr': '172.21.15.86:6829/1385217108', 'state': ['exists']}, {'osd': 6, 'uuid': 'e9aacee6-d441-4987-addf-617339375ef0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6809', 'nonce': 1465682528}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 1465682528}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6814', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6815', 'nonce': 1465682528}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6812', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6813', 'nonce': 1465682528}]}, 'public_addr': '172.21.15.86:6809/1465682528', 'cluster_addr': '172.21.15.86:6811/1465682528', 'heartbeat_back_addr': '172.21.15.86:6815/1465682528', 'heartbeat_front_addr': '172.21.15.86:6813/1465682528', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9e53e2c5-d137-442a-8ee8-9f8757a8e601', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6801', 'nonce': 2849091451}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6802', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 2849091451}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6806', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 2849091451}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6805', 'nonce': 2849091451}]}, 'public_addr': '172.21.15.86:6801/2849091451', 'cluster_addr': '172.21.15.86:6803/2849091451', 'heartbeat_back_addr': '172.21.15.86:6807/2849091451', 'heartbeat_front_addr': '172.21.15.86:6805/2849091451', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.746971+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.202992+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:32.026889+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.140575+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.188928+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.701967+0000', 'dead_epoch': 33}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.242666+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.149131+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T07:12:26.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:12:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:2526 write 0xed6d1bc thru 0xed7c15f (0xefa4 bytes) 2024-09-14T07:12:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:2527 write 0xd7d1ea5 thru 0xd7d7cba (0x5e16 bytes) 2024-09-14T07:12:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:2528 write 0xb5a43b0 thru 0xb5adcaa (0x98fb bytes) 2024-09-14T07:12:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2532 write 0x9dab7d3 thru 0x9db7c2e (0xc45c bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2533 punch from 0x6e9ec63 to 0x6ea0529, (0x18c6 bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2535 write 0x14d1717 thru 0x14d1b00 (0x3ea bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2537 write 0x45b20ff thru 0x45b342b (0x132d bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2538 write 0x9653205 thru 0x965e48f (0xb28b bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2539 trunc from 0xed7c160 to 0x59cacdc 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2540 punch from 0x4239847 to 0x4247fac, (0xe765 bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2543 read 0x3f28520 thru 0x3f2e057 (0x5b38 bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2545 writesame 0x7b8d2f6 thru 0x7b9c123 data_size 0x2b(0xee2e bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2546 punch from 0x32a2c5a to 0x32ae11e, (0xb4c4 bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2547 punch from 0x2383889 to 0x238e0aa, (0xa821 bytes) 2024-09-14T07:12:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:2551 read 0x275aed3 thru 0x2764528 (0x9656 bytes) 2024-09-14T07:12:26.450 INFO:teuthology.orchestra.run.smithi071.stdout:2552 writesame 0x23fce22 thru 0x24031fa data_size 0x1(0x63d9 bytes) 2024-09-14T07:12:26.450 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:26.363+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:26.452 INFO:teuthology.orchestra.run.smithi071.stdout:2553 write 0xdbbd1a9 thru 0xdbc1823 (0x467b bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2554 write 0xb8cd23b thru 0xb8d9eed (0xccb3 bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2555 writesame 0x8d1f06f thru 0x8d214f9 data_size 0x5(0x248b bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2556 read 0xd5de43 thru 0xd6a128 (0xc2e6 bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2559 write 0x1b134b6 thru 0x1b14aaf (0x15fa bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2561 writesame 0x9dabeac thru 0x9dbacf0 data_size 0x1(0xee45 bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2563 writesame 0xfc4765 thru 0xfc501c data_size 0x12(0x8b8 bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2564 read 0x6e54fd0 thru 0x6e57ef7 (0x2f28 bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2565 read 0x8d79564 thru 0x8d7a792 (0x122f bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2566 writesame 0x47dc8 thru 0x4be2f data_size 0x24(0x4068 bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2568 write 0xd5e282d thru 0xd5e520b (0x29df bytes) 2024-09-14T07:12:26.453 INFO:teuthology.orchestra.run.smithi071.stdout:2569 punch from 0xc5970b to 0xc59a79, (0x36e bytes) 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:2570 write 0x2e1bfa9 thru 0x2e20757 (0x47af bytes) 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:2576 read 0x266c1b9 thru 0x2673050 (0x6e98 bytes) 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:2577 trunc from 0xdbc1824 to 0x2d344f0 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:2579 write 0xc466c3e thru 0xc46a8b5 (0x3c78 bytes) 2024-09-14T07:12:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:2580 writesame 0x9b7fbf3 thru 0x9b8a55f data_size 0x1(0xa96d bytes) 2024-09-14T07:12:26.476 INFO:teuthology.orchestra.run.smithi071.stdout:2581 read 0x7795544 thru 0x7798336 (0x2df3 bytes) 2024-09-14T07:12:26.476 INFO:teuthology.orchestra.run.smithi071.stdout:2582 writesame 0x95f1f32 thru 0x95fd8bc data_size 0x3(0xb98b bytes) 2024-09-14T07:12:26.477 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:26.476+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:26.484 INFO:teuthology.orchestra.run.smithi071.stdout:2584 punch from 0x837f1fb to 0x8381efc, (0x2d01 bytes) 2024-09-14T07:12:26.484 INFO:teuthology.orchestra.run.smithi071.stdout:2585 write 0x8870ec7 thru 0x8879106 (0x8240 bytes) 2024-09-14T07:12:26.487 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:26.487 INFO:teuthology.orchestra.run.smithi071.stdout:2587 read 0x2d5db54 thru 0x2d65fc2 (0x846f bytes) 2024-09-14T07:12:26.487 INFO:teuthology.orchestra.run.smithi071.stdout:2588 write 0x92727c3 thru 0x927b017 (0x8855 bytes) 2024-09-14T07:12:26.489 INFO:teuthology.orchestra.run.smithi071.stdout:2589 read 0x2f1e9e thru 0x2f8f3f (0x70a2 bytes) 2024-09-14T07:12:26.490 INFO:teuthology.orchestra.run.smithi071.stdout:2591 clone 20 order 18 su 16384 sc 8 2024-09-14T07:12:26.547 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:26.547 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:26.548 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:26.548 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:26.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:26.599 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:26.597+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:26.657 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:26.657 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:26.657 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:26.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:26.666 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:26.665+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:26.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:12:26.742 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:12:26.752 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-14T07:12:26.347716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":870780176,"num_objects":658,"num_object_clones":218,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":184,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":179,"num_read":64936,"num_read_kb":346461,"num_write":6559,"num_write_kb":190811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5187,"ondisk_log_size":5187,"up":71,"acting":71,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":465340,"kb_used_data":207448,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754509380,"statfs":{"total":773094113280,"available":772617605120,"internally_reserved":0,"allocated":212426752,"data_stored":304439132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":190822541,"num_objects":150,"num_object_clones":64,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":37,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":59,"num_read":7728,"num_read_kb":74651,"num_write":1321,"num_write_kb":43951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.558960"},"pg_stats":[{"pgid":"3.1f","version":"51'306","reported_seq":2829,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.817699+0000","last_change":"2024-09-14T07:12:03.687446+0000","last_active":"2024-09-14T07:12:24.817699+0000","last_peered":"2024-09-14T07:12:24.817699+0000","last_clean":"2024-09-14T07:12:02.182986+0000","last_became_active":"2024-09-14T07:12:03.687446+0000","last_became_peered":"2024-09-14T07:12:03.687446+0000","last_unstale":"2024-09-14T07:12:24.817699+0000","last_undegraded":"2024-09-14T07:12:03.686750+0000","last_fullsized":"2024-09-14T07:12:03.686663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:44.211571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012858609999999999,"stat_sum":{"num_bytes":10968028,"num_objects":30,"num_object_clones":12,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":30,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":11,"num_read":3983,"num_read_kb":12563,"num_write":459,"num_write_kb":4014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":30}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"53'88","reported_seq":1052,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.819305+0000","last_change":"2024-09-14T07:12:21.795713+0000","last_active":"2024-09-14T07:12:24.819305+0000","last_peered":"2024-09-14T07:12:24.819305+0000","last_clean":"2024-09-14T07:12:24.819305+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:12:24.819305+0000","last_undegraded":"2024-09-14T07:12:24.819305+0000","last_fullsized":"2024-09-14T07:12:24.819305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:18.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079792100000000005,"stat_sum":{"num_bytes":17188955,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":8,"num_read":895,"num_read_kb":5518,"num_write":108,"num_write_kb":12814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"51'61","reported_seq":1274,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.827074+0000","last_change":"2024-09-14T07:12:03.689201+0000","last_active":"2024-09-14T07:12:24.827074+0000","last_peered":"2024-09-14T07:12:24.827074+0000","last_clean":"2024-09-14T07:12:01.804976+0000","last_became_active":"2024-09-14T07:12:03.689201+0000","last_became_peered":"2024-09-14T07:12:03.689201+0000","last_unstale":"2024-09-14T07:12:24.827074+0000","last_undegraded":"2024-09-14T07:12:03.688117+0000","last_fullsized":"2024-09-14T07:12:03.688034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:16.879677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001026585,"stat_sum":{"num_bytes":12406458,"num_objects":12,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":1151,"num_read_kb":5671,"num_write":68,"num_write_kb":2662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":12}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"54'121","reported_seq":866,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.835328+0000","last_change":"2024-09-14T07:12:03.688976+0000","last_active":"2024-09-14T07:12:24.835328+0000","last_peered":"2024-09-14T07:12:24.835328+0000","last_clean":"2024-09-14T07:12:02.077164+0000","last_became_active":"2024-09-14T07:12:03.688976+0000","last_became_peered":"2024-09-14T07:12:03.688976+0000","last_unstale":"2024-09-14T07:12:24.835328+0000","last_undegraded":"2024-09-14T07:12:03.688136+0000","last_fullsized":"2024-09-14T07:12:03.688019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:36.040735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088611199999999999,"stat_sum":{"num_bytes":50929361,"num_objects":29,"num_object_clones":12,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":6,"num_read":946,"num_read_kb":9608,"num_write":117,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":29}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"53'161","reported_seq":2098,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817857+0000","last_change":"2024-09-14T07:11:53.652707+0000","last_active":"2024-09-14T07:12:24.817857+0000","last_peered":"2024-09-14T07:12:24.817857+0000","last_clean":"2024-09-14T07:12:24.817857+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:12:24.817857+0000","last_undegraded":"2024-09-14T07:12:24.817857+0000","last_fullsized":"2024-09-14T07:12:24.817857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:13:08.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062975399999999995,"stat_sum":{"num_bytes":9715983,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":2122,"num_read_kb":8346,"num_write":196,"num_write_kb":1588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"53'487","reported_seq":1588,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.860255+0000","last_change":"2024-09-14T07:11:53.643789+0000","last_active":"2024-09-14T07:12:24.860255+0000","last_peered":"2024-09-14T07:12:24.860255+0000","last_clean":"2024-09-14T07:12:24.860255+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:12:24.860255+0000","last_undegraded":"2024-09-14T07:12:24.860255+0000","last_fullsized":"2024-09-14T07:12:24.860255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:20:06.036650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078296400000000003,"stat_sum":{"num_bytes":47696616,"num_objects":27,"num_object_clones":8,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":3256,"num_read_kb":15436,"num_write":831,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"54'108","reported_seq":3854,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.851909+0000","last_change":"2024-09-14T07:11:53.641714+0000","last_active":"2024-09-14T07:12:24.851909+0000","last_peered":"2024-09-14T07:12:24.851909+0000","last_clean":"2024-09-14T07:12:24.851909+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:12:24.851909+0000","last_undegraded":"2024-09-14T07:12:24.851909+0000","last_fullsized":"2024-09-14T07:12:24.851909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:39:11.000374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039260599999999999,"stat_sum":{"num_bytes":22059090,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":3761,"num_read_kb":12039,"num_write":111,"num_write_kb":1820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"51'52","reported_seq":1118,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817926+0000","last_change":"2024-09-14T07:12:21.799027+0000","last_active":"2024-09-14T07:12:24.817926+0000","last_peered":"2024-09-14T07:12:24.817926+0000","last_clean":"2024-09-14T07:12:24.817926+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:12:24.817926+0000","last_undegraded":"2024-09-14T07:12:24.817926+0000","last_fullsized":"2024-09-14T07:12:24.817926+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:51.309665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051195600000000004,"stat_sum":{"num_bytes":21234943,"num_objects":14,"num_object_clones":5,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":985,"num_read_kb":13375,"num_write":88,"num_write_kb":9563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"54'285","reported_seq":2535,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.857610+0000","last_change":"2024-09-14T07:12:03.690079+0000","last_active":"2024-09-14T07:12:24.857610+0000","last_peered":"2024-09-14T07:12:24.857610+0000","last_clean":"2024-09-14T07:12:02.049833+0000","last_became_active":"2024-09-14T07:12:03.690079+0000","last_became_peered":"2024-09-14T07:12:03.690079+0000","last_unstale":"2024-09-14T07:12:24.857610+0000","last_undegraded":"2024-09-14T07:12:03.686958+0000","last_fullsized":"2024-09-14T07:12:03.686872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:12.683589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099453200000000001,"stat_sum":{"num_bytes":20066173,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":3579,"num_read_kb":14977,"num_write":408,"num_write_kb":5054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"54'100","reported_seq":1466,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.847563+0000","last_change":"2024-09-14T07:12:03.694320+0000","last_active":"2024-09-14T07:12:24.847563+0000","last_peered":"2024-09-14T07:12:24.847563+0000","last_clean":"2024-09-14T07:12:02.114005+0000","last_became_active":"2024-09-14T07:12:03.694320+0000","last_became_peered":"2024-09-14T07:12:03.694320+0000","last_unstale":"2024-09-14T07:12:24.847563+0000","last_undegraded":"2024-09-14T07:12:03.691993+0000","last_fullsized":"2024-09-14T07:12:03.691911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:30.240054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106477,"stat_sum":{"num_bytes":21530814,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":1742,"num_read_kb":5408,"num_write":96,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":22}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"52'182","reported_seq":411,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.844644+0000","last_change":"2024-09-14T07:12:15.765427+0000","last_active":"2024-09-14T07:12:24.844644+0000","last_peered":"2024-09-14T07:12:24.844644+0000","last_clean":"2024-09-14T07:12:24.844644+0000","last_became_active":"2024-09-14T07:12:15.764942+0000","last_became_peered":"2024-09-14T07:12:15.764942+0000","last_unstale":"2024-09-14T07:12:24.844644+0000","last_undegraded":"2024-09-14T07:12:24.844644+0000","last_fullsized":"2024-09-14T07:12:24.844644+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:58.875140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060585999999999995,"stat_sum":{"num_bytes":21288647,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":801,"num_read_kb":4995,"num_write":238,"num_write_kb":2614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"51'140","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.827156+0000","last_change":"2024-09-14T07:11:53.643815+0000","last_active":"2024-09-14T07:12:24.827156+0000","last_peered":"2024-09-14T07:12:24.827156+0000","last_clean":"2024-09-14T07:12:24.827156+0000","last_became_active":"2024-09-14T07:11:51.642949+0000","last_became_peered":"2024-09-14T07:11:51.642949+0000","last_unstale":"2024-09-14T07:12:24.827156+0000","last_undegraded":"2024-09-14T07:12:24.827156+0000","last_fullsized":"2024-09-14T07:12:24.827156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.209907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075362300000000003,"stat_sum":{"num_bytes":14840885,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":5,"num_read":1143,"num_read_kb":6051,"num_write":178,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.819205+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:12:24.819205+0000","last_peered":"2024-09-14T07:12:24.819205+0000","last_clean":"2024-09-14T07:12:24.819205+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:12:24.819205+0000","last_undegraded":"2024-09-14T07:12:24.819205+0000","last_fullsized":"2024-09-14T07:12:24.819205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'497","reported_seq":2735,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.864689+0000","last_change":"2024-09-14T07:11:53.652733+0000","last_active":"2024-09-14T07:12:24.864689+0000","last_peered":"2024-09-14T07:12:24.864689+0000","last_clean":"2024-09-14T07:12:24.864689+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:12:24.864689+0000","last_undegraded":"2024-09-14T07:12:24.864689+0000","last_fullsized":"2024-09-14T07:12:24.864689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:08.259383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000363259,"stat_sum":{"num_bytes":44092973,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":3,"num_read":4985,"num_read_kb":21734,"num_write":661,"num_write_kb":6636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.814942+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:12:24.814942+0000","last_peered":"2024-09-14T07:12:24.814942+0000","last_clean":"2024-09-14T07:12:24.814942+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:12:24.814942+0000","last_undegraded":"2024-09-14T07:12:24.814942+0000","last_fullsized":"2024-09-14T07:12:24.814942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'36","reported_seq":1678,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.844417+0000","last_change":"2024-09-14T07:11:53.640613+0000","last_active":"2024-09-14T07:12:24.844417+0000","last_peered":"2024-09-14T07:12:24.844417+0000","last_clean":"2024-09-14T07:12:24.844417+0000","last_became_active":"2024-09-14T07:11:51.646069+0000","last_became_peered":"2024-09-14T07:11:51.646069+0000","last_unstale":"2024-09-14T07:12:24.844417+0000","last_undegraded":"2024-09-14T07:12:24.844417+0000","last_fullsized":"2024-09-14T07:12:24.844417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:26.255091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000781688,"stat_sum":{"num_bytes":1503232,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1553,"num_read_kb":4864,"num_write":36,"num_write_kb":1227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817473+0000","last_change":"2024-09-14T07:12:15.765521+0000","last_active":"2024-09-14T07:12:24.817473+0000","last_peered":"2024-09-14T07:12:24.817473+0000","last_clean":"2024-09-14T07:12:24.817473+0000","last_became_active":"2024-09-14T07:12:15.765216+0000","last_became_peered":"2024-09-14T07:12:15.765216+0000","last_unstale":"2024-09-14T07:12:24.817473+0000","last_undegraded":"2024-09-14T07:12:24.817473+0000","last_fullsized":"2024-09-14T07:12:24.817473+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.152750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"53'145","reported_seq":783,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.814907+0000","last_change":"2024-09-14T07:11:53.641816+0000","last_active":"2024-09-14T07:12:24.814907+0000","last_peered":"2024-09-14T07:12:24.814907+0000","last_clean":"2024-09-14T07:12:24.814907+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:12:24.814907+0000","last_undegraded":"2024-09-14T07:12:24.814907+0000","last_fullsized":"2024-09-14T07:12:24.814907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:18.104701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046618899999999999,"stat_sum":{"num_bytes":26030755,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":4,"num_read":1660,"num_read_kb":7180,"num_write":138,"num_write_kb":4028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.815060+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:12:24.815060+0000","last_peered":"2024-09-14T07:12:24.815060+0000","last_clean":"2024-09-14T07:12:24.815060+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:12:24.815060+0000","last_undegraded":"2024-09-14T07:12:24.815060+0000","last_fullsized":"2024-09-14T07:12:24.815060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"53'128","reported_seq":274,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.844612+0000","last_change":"2024-09-14T07:12:03.695737+0000","last_active":"2024-09-14T07:12:24.844612+0000","last_peered":"2024-09-14T07:12:24.844612+0000","last_clean":"2024-09-14T07:12:02.196630+0000","last_became_active":"2024-09-14T07:12:03.695737+0000","last_became_peered":"2024-09-14T07:12:03.695737+0000","last_unstale":"2024-09-14T07:12:24.844612+0000","last_undegraded":"2024-09-14T07:12:03.690877+0000","last_fullsized":"2024-09-14T07:12:03.690785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:37.513246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094557899999999999,"stat_sum":{"num_bytes":17684142,"num_objects":24,"num_object_clones":9,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":24,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":8,"num_read":102,"num_read_kb":5656,"num_write":123,"num_write_kb":10185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":24}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"53'85","reported_seq":1162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.827067+0000","last_change":"2024-09-14T07:11:53.643999+0000","last_active":"2024-09-14T07:12:24.827067+0000","last_peered":"2024-09-14T07:12:24.827067+0000","last_clean":"2024-09-14T07:12:24.827067+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:12:24.827067+0000","last_undegraded":"2024-09-14T07:12:24.827067+0000","last_fullsized":"2024-09-14T07:12:24.827067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:22.398428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091878800000000003,"stat_sum":{"num_bytes":45456887,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":3,"num_read":1032,"num_read_kb":10311,"num_write":151,"num_write_kb":12637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":67,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.814956+0000","last_change":"2024-09-14T07:12:03.687245+0000","last_active":"2024-09-14T07:12:24.814956+0000","last_peered":"2024-09-14T07:12:24.814956+0000","last_clean":"2024-09-14T07:11:44.172729+0000","last_became_active":"2024-09-14T07:12:03.687245+0000","last_became_peered":"2024-09-14T07:12:03.687245+0000","last_unstale":"2024-09-14T07:12:24.814956+0000","last_undegraded":"2024-09-14T07:12:03.686553+0000","last_fullsized":"2024-09-14T07:12:03.686434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:17.889127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'106","reported_seq":1425,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.814856+0000","last_change":"2024-09-14T07:11:53.642216+0000","last_active":"2024-09-14T07:12:24.814856+0000","last_peered":"2024-09-14T07:12:24.814856+0000","last_clean":"2024-09-14T07:12:24.814856+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:12:24.814856+0000","last_undegraded":"2024-09-14T07:12:24.814856+0000","last_fullsized":"2024-09-14T07:12:24.814856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:14.974237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036810599999999999,"stat_sum":{"num_bytes":45067023,"num_objects":25,"num_object_clones":9,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":5,"num_read":1595,"num_read_kb":20720,"num_write":101,"num_write_kb":7335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.814608+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:12:24.814608+0000","last_peered":"2024-09-14T07:12:24.814608+0000","last_clean":"2024-09-14T07:12:24.814608+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:12:24.814608+0000","last_undegraded":"2024-09-14T07:12:24.814608+0000","last_fullsized":"2024-09-14T07:12:24.814608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"53'115","reported_seq":2316,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817396+0000","last_change":"2024-09-14T07:11:53.652453+0000","last_active":"2024-09-14T07:12:24.817396+0000","last_peered":"2024-09-14T07:12:24.817396+0000","last_clean":"2024-09-14T07:12:24.817396+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:12:24.817396+0000","last_undegraded":"2024-09-14T07:12:24.817396+0000","last_fullsized":"2024-09-14T07:12:24.817396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:27.923491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045273699999999999,"stat_sum":{"num_bytes":31056336,"num_objects":18,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":2181,"num_read_kb":17729,"num_write":136,"num_write_kb":15044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.814803+0000","last_change":"2024-09-14T07:12:15.765297+0000","last_active":"2024-09-14T07:12:24.814803+0000","last_peered":"2024-09-14T07:12:24.814803+0000","last_clean":"2024-09-14T07:12:24.814803+0000","last_became_active":"2024-09-14T07:12:15.765018+0000","last_became_peered":"2024-09-14T07:12:15.765018+0000","last_unstale":"2024-09-14T07:12:24.814803+0000","last_undegraded":"2024-09-14T07:12:24.814803+0000","last_fullsized":"2024-09-14T07:12:24.814803+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:02.766098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"51'75","reported_seq":1186,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.844261+0000","last_change":"2024-09-14T07:12:03.695806+0000","last_active":"2024-09-14T07:12:24.844261+0000","last_peered":"2024-09-14T07:12:24.844261+0000","last_clean":"2024-09-14T07:12:02.182931+0000","last_became_active":"2024-09-14T07:12:03.695806+0000","last_became_peered":"2024-09-14T07:12:03.695806+0000","last_unstale":"2024-09-14T07:12:24.844261+0000","last_undegraded":"2024-09-14T07:12:03.691035+0000","last_fullsized":"2024-09-14T07:12:03.690931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:55.599840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076532499999999997,"stat_sum":{"num_bytes":13706071,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":1045,"num_read_kb":8804,"num_write":75,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":18}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":52,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.814542+0000","last_change":"2024-09-14T07:12:03.692906+0000","last_active":"2024-09-14T07:12:24.814542+0000","last_peered":"2024-09-14T07:12:24.814542+0000","last_clean":"2024-09-14T07:11:41.141514+0000","last_became_active":"2024-09-14T07:12:03.692906+0000","last_became_peered":"2024-09-14T07:12:03.692906+0000","last_unstale":"2024-09-14T07:12:24.814542+0000","last_undegraded":"2024-09-14T07:12:03.691045+0000","last_fullsized":"2024-09-14T07:12:03.690955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:46.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":125,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817396+0000","last_change":"2024-09-14T07:12:15.764696+0000","last_active":"2024-09-14T07:12:24.817396+0000","last_peered":"2024-09-14T07:12:24.817396+0000","last_clean":"2024-09-14T07:12:24.817396+0000","last_became_active":"2024-09-14T07:12:15.764436+0000","last_became_peered":"2024-09-14T07:12:15.764436+0000","last_unstale":"2024-09-14T07:12:24.817396+0000","last_undegraded":"2024-09-14T07:12:24.817396+0000","last_fullsized":"2024-09-14T07:12:24.817396+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"52'295","reported_seq":2490,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.844190+0000","last_change":"2024-09-14T07:11:53.640836+0000","last_active":"2024-09-14T07:12:24.844190+0000","last_peered":"2024-09-14T07:12:24.844190+0000","last_clean":"2024-09-14T07:12:24.844190+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:12:24.844190+0000","last_undegraded":"2024-09-14T07:12:24.844190+0000","last_fullsized":"2024-09-14T07:12:24.844190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:03.039697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079425600000000002,"stat_sum":{"num_bytes":16526302,"num_objects":28,"num_object_clones":10,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":6,"num_read":4171,"num_read_kb":16979,"num_write":378,"num_write_kb":6474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"53'130","reported_seq":1663,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.826989+0000","last_change":"2024-09-14T07:11:53.644030+0000","last_active":"2024-09-14T07:12:24.826989+0000","last_peered":"2024-09-14T07:12:24.826989+0000","last_clean":"2024-09-14T07:12:24.826989+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:12:24.826989+0000","last_undegraded":"2024-09-14T07:12:24.826989+0000","last_fullsized":"2024-09-14T07:12:24.826989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:26.319286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090377899999999995,"stat_sum":{"num_bytes":19866266,"num_objects":16,"num_object_clones":5,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":2455,"num_read_kb":9343,"num_write":136,"num_write_kb":2906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"54'224","reported_seq":1004,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.819295+0000","last_change":"2024-09-14T07:11:54.071502+0000","last_active":"2024-09-14T07:12:24.819295+0000","last_peered":"2024-09-14T07:12:24.819295+0000","last_clean":"2024-09-14T07:12:24.819295+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:12:24.819295+0000","last_undegraded":"2024-09-14T07:12:24.819295+0000","last_fullsized":"2024-09-14T07:12:24.819295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:37.725920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031753199999999998,"stat_sum":{"num_bytes":34585820,"num_objects":26,"num_object_clones":9,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":7,"num_read":1111,"num_read_kb":23892,"num_write":278,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"53'111","reported_seq":1641,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817735+0000","last_change":"2024-09-14T07:12:21.798789+0000","last_active":"2024-09-14T07:12:24.817735+0000","last_peered":"2024-09-14T07:12:24.817735+0000","last_clean":"2024-09-14T07:12:24.817735+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:12:24.817735+0000","last_undegraded":"2024-09-14T07:12:24.817735+0000","last_fullsized":"2024-09-14T07:12:24.817735+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:43.718827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052900400000000002,"stat_sum":{"num_bytes":70932907,"num_objects":29,"num_object_clones":11,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":1481,"num_read_kb":12178,"num_write":108,"num_write_kb":3996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"53'80","reported_seq":2962,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.844289+0000","last_change":"2024-09-14T07:12:03.692955+0000","last_active":"2024-09-14T07:12:24.844289+0000","last_peered":"2024-09-14T07:12:24.844289+0000","last_clean":"2024-09-14T07:12:02.167669+0000","last_became_active":"2024-09-14T07:12:03.692955+0000","last_became_peered":"2024-09-14T07:12:03.692955+0000","last_unstale":"2024-09-14T07:12:24.844289+0000","last_undegraded":"2024-09-14T07:12:03.690846+0000","last_fullsized":"2024-09-14T07:12:03.690747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:49.465165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081047900000000002,"stat_sum":{"num_bytes":52164168,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2871,"num_read_kb":16543,"num_write":95,"num_write_kb":4770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":12}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"52'184","reported_seq":2183,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:24.847506+0000","last_change":"2024-09-14T07:12:03.696929+0000","last_active":"2024-09-14T07:12:24.847506+0000","last_peered":"2024-09-14T07:12:24.847506+0000","last_clean":"2024-09-14T07:12:02.196725+0000","last_became_active":"2024-09-14T07:12:03.696929+0000","last_became_peered":"2024-09-14T07:12:03.696929+0000","last_unstale":"2024-09-14T07:12:24.847506+0000","last_undegraded":"2024-09-14T07:12:03.692111+0000","last_fullsized":"2024-09-14T07:12:03.692065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:05.648694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072059800000000003,"stat_sum":{"num_bytes":22430283,"num_objects":20,"num_object_clones":6,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":2767,"num_read_kb":10608,"num_write":218,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":20}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"49'59","reported_seq":1341,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.827264+0000","last_change":"2024-09-14T07:12:15.765724+0000","last_active":"2024-09-14T07:12:24.827264+0000","last_peered":"2024-09-14T07:12:24.827264+0000","last_clean":"2024-09-14T07:12:24.827264+0000","last_became_active":"2024-09-14T07:12:15.765001+0000","last_became_peered":"2024-09-14T07:12:15.765001+0000","last_unstale":"2024-09-14T07:12:24.827264+0000","last_undegraded":"2024-09-14T07:12:24.827264+0000","last_fullsized":"2024-09-14T07:12:24.827264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:59.800257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066558700000000004,"stat_sum":{"num_bytes":27259867,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":4,"num_read":1210,"num_read_kb":7358,"num_write":53,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"51'224","reported_seq":2239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.827072+0000","last_change":"2024-09-14T07:12:15.766663+0000","last_active":"2024-09-14T07:12:24.827072+0000","last_peered":"2024-09-14T07:12:24.827072+0000","last_clean":"2024-09-14T07:12:24.827072+0000","last_became_active":"2024-09-14T07:12:15.764966+0000","last_became_peered":"2024-09-14T07:12:15.764966+0000","last_unstale":"2024-09-14T07:12:24.827072+0000","last_undegraded":"2024-09-14T07:12:24.827072+0000","last_fullsized":"2024-09-14T07:12:24.827072+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:50.335005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054667400000000003,"stat_sum":{"num_bytes":47239525,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":3378,"num_read_kb":14592,"num_write":272,"num_write_kb":7150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"53'169","reported_seq":550,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.819223+0000","last_change":"2024-09-14T07:11:54.071547+0000","last_active":"2024-09-14T07:12:24.819223+0000","last_peered":"2024-09-14T07:12:24.819223+0000","last_clean":"2024-09-14T07:12:24.819223+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:12:24.819223+0000","last_undegraded":"2024-09-14T07:12:24.819223+0000","last_fullsized":"2024-09-14T07:12:24.819223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:50:26.496248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032913099999999998,"stat_sum":{"num_bytes":16578293,"num_objects":22,"num_object_clones":7,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":6,"num_read":1161,"num_read_kb":7146,"num_write":217,"num_write_kb":5963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"51'93","reported_seq":1666,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.826879+0000","last_change":"2024-09-14T07:12:15.765421+0000","last_active":"2024-09-14T07:12:24.826879+0000","last_peered":"2024-09-14T07:12:24.826879+0000","last_clean":"2024-09-14T07:12:24.826879+0000","last_became_active":"2024-09-14T07:12:15.764948+0000","last_became_peered":"2024-09-14T07:12:15.764948+0000","last_unstale":"2024-09-14T07:12:24.826879+0000","last_undegraded":"2024-09-14T07:12:24.826879+0000","last_fullsized":"2024-09-14T07:12:24.826879+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:11.389254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036086199999999999,"stat_sum":{"num_bytes":25349030,"num_objects":23,"num_object_clones":8,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":8,"num_read":1808,"num_read_kb":5176,"num_write":89,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"52'130","reported_seq":800,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.817422+0000","last_change":"2024-09-14T07:11:53.652524+0000","last_active":"2024-09-14T07:12:24.817422+0000","last_peered":"2024-09-14T07:12:24.817422+0000","last_clean":"2024-09-14T07:12:24.817422+0000","last_became_active":"2024-09-14T07:11:51.643426+0000","last_became_peered":"2024-09-14T07:11:51.643426+0000","last_unstale":"2024-09-14T07:12:24.817422+0000","last_undegraded":"2024-09-14T07:12:24.817422+0000","last_fullsized":"2024-09-14T07:12:24.817422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:25.701465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041604400000000002,"stat_sum":{"num_bytes":4720987,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":7,"num_read":1636,"num_read_kb":2544,"num_write":126,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"53'135","reported_seq":2231,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T07:12:24.827167+0000","last_change":"2024-09-14T07:12:15.766483+0000","last_active":"2024-09-14T07:12:24.827167+0000","last_peered":"2024-09-14T07:12:24.827167+0000","last_clean":"2024-09-14T07:12:24.827167+0000","last_became_active":"2024-09-14T07:12:15.765178+0000","last_became_peered":"2024-09-14T07:12:15.765178+0000","last_unstale":"2024-09-14T07:12:24.827167+0000","last_undegraded":"2024-09-14T07:12:24.827167+0000","last_fullsized":"2024-09-14T07:12:24.827167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:02.145804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039914099999999999,"stat_sum":{"num_bytes":38012969,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":2304,"num_read_kb":9062,"num_write":167,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":870189789,"num_objects":654,"num_object_clones":218,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":179,"num_read":64870,"num_read_kb":346406,"num_write":6456,"num_write_kb":189181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":207032320,"data_stored":301593345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5112,"ondisk_log_size":5112,"up":55,"acting":55,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48240,"kb_used_data":17048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323600,"statfs":{"total":96636764160,"available":96587366400,"internally_reserved":0,"allocated":17457152,"data_stored":26617420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":19512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":19980288,"data_stored":27780253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":1216766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80948,"kb_used_data":45536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94290892,"statfs":{"total":96636764160,"available":96553873408,"internally_reserved":0,"allocated":46628864,"data_stored":64198773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70764,"kb_used_data":39576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94301076,"statfs":{"total":96636764160,"available":96564301824,"internally_reserved":0,"allocated":40525824,"data_stored":58217120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44404,"kb_used_data":13212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327436,"statfs":{"total":96636764160,"available":96591294464,"internally_reserved":0,"allocated":13529088,"data_stored":20806364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63428,"kb_used_data":32244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94308412,"statfs":{"total":96636764160,"available":96571813888,"internally_reserved":0,"allocated":33017856,"data_stored":50539756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74448,"kb_used_data":39100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94297392,"statfs":{"total":96636764160,"available":96560529408,"internally_reserved":0,"allocated":40038400,"data_stored":55062680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38825984,"data_stored":54201768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32432128,"data_stored":50289508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12939264,"data_stored":20555266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39989248,"data_stored":58010789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46260224,"data_stored":64145159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":1112303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19374080,"data_stored":27515852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16261120,"data_stored":25762700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:12:26.754 INFO:tasks.thrashosds.thrasher:Setting 3.11 to [7, 4, 1, 3] 2024-09-14T07:12:26.754 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.11', '7', '4', '1', '3'] 2024-09-14T07:12:26.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.11 7 4 1 3 2024-09-14T07:12:26.766 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:26.765+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:26.808 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:26.808 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9449 3.a 3:56e24ad3:::rbd_data.1182b13d849f.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18850559~65145] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.7389507, 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039129075999999999, 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9449 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068072+0000", 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1220000000000002e-06 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082261+0000", 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014189286000000001 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082289+0000", 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8123000000000002e-05 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082307+0000", 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7864e-05 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082406+0000", 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9223999999999997e-05 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082564+0000", 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015800499999999999 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083260+0000", 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069602200000000003 2024-09-14T07:12:26.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106367+0000", 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023106318000000001 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107084+0000", 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000717036 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:26.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107149+0000", 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5581999999999997e-05 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107199+0000", 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9493999999999997e-05 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:26.815 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9502095099999996, 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:12:26.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:12:26.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48351 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 16515072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.228964+0000", 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.578056111, 2024-09-14T07:12:26.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030658991999999999, 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48351 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228964+0000", 2024-09-14T07:12:26.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228964+0000", 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228965+0000", 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228966+0000", 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.753e-06 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228972+0000", 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8220000000000003e-06 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228977+0000", 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.498e-06 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259525+0000", 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030548128000000001 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259570+0000", 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5129000000000001e-05 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259623+0000", 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3310000000000003e-05 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48375 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 1703936~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229039+0000", 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.577980978, 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031125238, 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48375 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229039+0000", 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229039+0000", 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229040+0000", 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3099999999999997e-07 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229043+0000", 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.241e-06 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229051+0000", 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.374e-06 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229056+0000", 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259672+0000", 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030616606000000001 2024-09-14T07:12:26.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259734+0000", 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1563999999999995e-05 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260165+0000", 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00043061199999999998 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48376 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 3670016~6815] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229064+0000", 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5779560180000001, 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031535727, 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48376 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.832 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229064+0000", 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229064+0000", 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229065+0000", 2024-09-14T07:12:26.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229072+0000", 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3420000000000002e-06 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229078+0000", 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2940000000000002e-06 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229085+0000", 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6170000000000003e-06 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260208+0000", 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031123293 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260283+0000", 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4300000000000004e-05 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260600+0000", 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031748099999999999 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48377 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.577922724, 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031659055999999998, 2024-09-14T07:12:26.836 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48377 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4799999999999998e-07 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229100+0000", 2024-09-14T07:12:26.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0710000000000002e-06 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229106+0000", 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229113+0000", 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1369999999999999e-06 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260639+0000", 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031525985999999999 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260688+0000", 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9172000000000003e-05 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260757+0000", 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8910000000000003e-05 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.840 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48378 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5778996969999999, 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031840194000000002, 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48378 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6199999999999998e-07 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229123+0000", 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.796e-06 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229129+0000", 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8749999999999997e-06 2024-09-14T07:12:26.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229139+0000", 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0030000000000001e-05 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260795+0000", 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031656419999999998 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260868+0000", 2024-09-14T07:12:26.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3013e-05 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260961+0000", 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2597999999999997e-05 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48379 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 9043968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:26.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5778747960000001, 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031949770000000002, 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48379 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:26.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229148+0000", 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229154+0000", 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6470000000000001e-06 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229159+0000", 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6299999999999997e-06 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260996+0000", 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031836510999999998 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261039+0000", 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3421999999999999e-05 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261095+0000", 2024-09-14T07:12:26.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6288e-05 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48380 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 11010048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5778544480000001, 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032123634999999998, 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48380 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1399999999999998e-07 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229168+0000", 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.584e-06 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229173+0000", 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3009999999999997e-06 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229178+0000", 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2510000000000002e-06 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261128+0000", 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031949970000000001 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261204+0000", 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5254999999999997e-05 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261290+0000", 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5959999999999997e-05 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48381 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 12713984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.577832795, 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032214700999999998, 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48381 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229190+0000", 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0640000000000001e-06 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229196+0000", 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9830000000000001e-06 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229206+0000", 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8439999999999993e-06 2024-09-14T07:12:26.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261316+0000", 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032110412999999997 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261354+0000", 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7935000000000002e-05 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261402+0000", 2024-09-14T07:12:26.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8102000000000001e-05 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48382 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 14680064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5777874779999999, 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.03235946, 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48382 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:26.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229236+0000", 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.199e-06 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229242+0000", 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5490000000000003e-06 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229247+0000", 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7709999999999997e-06 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261435+0000", 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032187597999999998 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261507+0000", 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2169000000000006e-05 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261592+0000", 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5612000000000006e-05 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48383 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 16646144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5777668380000001, 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032437607, 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48383 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5299999999999999e-07 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229256+0000", 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7850000000000001e-06 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229261+0000", 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.733e-06 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229266+0000", 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.578e-06 2024-09-14T07:12:26.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261607+0000", 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032341038000000003 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261644+0000", 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7392999999999999e-05 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261691+0000", 2024-09-14T07:12:26.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6626999999999999e-05 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48407 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 1835008~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229504+0000", 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5775160939999999, 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032756399999999998, 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48407 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229504+0000", 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229504+0000", 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229505+0000", 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9400000000000004e-07 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229508+0000", 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1879999999999998e-06 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229517+0000", 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1500000000000005e-06 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229523+0000", 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.48e-06 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261721+0000", 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032198348000000002 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261793+0000", 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1414000000000004e-05 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262261+0000", 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00046802600000000002 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48408 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229533+0000", 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5774869549999999, 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032883879999999997, 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48408 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229533+0000", 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229533+0000", 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229534+0000", 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3000000000000001e-07 2024-09-14T07:12:26.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229536+0000", 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.193e-06 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229542+0000", 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3770000000000001e-06 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229547+0000", 2024-09-14T07:12:26.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8570000000000003e-06 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262294+0000", 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032746535 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262352+0000", 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8068e-05 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262417+0000", 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5320000000000005e-05 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48409 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.577466821, 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033055492999999998, 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48409 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2500000000000001e-07 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229556+0000", 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.708e-06 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229561+0000", 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6069999999999998e-06 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229565+0000", 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3229999999999999e-06 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262450+0000", 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032884871000000003 2024-09-14T07:12:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262524+0000", 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3440000000000002e-05 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262609+0000", 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5218999999999998e-05 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48410 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5774488450000002, 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033170810000000002, 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48410 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.882 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:26.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229579+0000", 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.571e-06 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229586+0000", 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9229999999999996e-06 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229595+0000", 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1470000000000007e-06 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262639+0000", 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033043425000000001 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262687+0000", 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8479000000000001e-05 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262742+0000", 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4957999999999998e-05 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48411 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 9175040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229602+0000", 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5774179319999999, 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033277501000000001, 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.886 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48411 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229602+0000", 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229602+0000", 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229603+0000", 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7800000000000002e-07 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229611+0000", 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2020000000000004e-06 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229617+0000", 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2190000000000001e-06 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229622+0000", 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7679999999999999e-06 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262780+0000", 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033158172 2024-09-14T07:12:26.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262828+0000", 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7815999999999998e-05 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262880+0000", 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1946e-05 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48412 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 11141120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.577391564, 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033383283999999999, 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48412 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:26.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229631+0000", 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.773e-06 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229637+0000", 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8549999999999998e-06 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229641+0000", 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262915+0000", 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033273502000000003 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262951+0000", 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6297999999999997e-05 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263012+0000", 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0905e-05 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48413 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 12845056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5773605669999999, 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033548144000000002, 2024-09-14T07:12:26.895 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48413 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7999999999999995e-07 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229663+0000", 2024-09-14T07:12:26.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9469999999999999e-06 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229670+0000", 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5930000000000002e-06 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229675+0000", 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263049+0000", 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033374643000000002 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263120+0000", 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0828999999999996e-05 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263208+0000", 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7733999999999997e-05 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48414 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229681+0000", 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 1.5773392450000001, 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033633070000000001, 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48414 2024-09-14T07:12:26.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229681+0000", 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229681+0000", 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229682+0000", 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1699999999999999e-07 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229683+0000", 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.649e-06 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229689+0000", 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.558e-06 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229693+0000", 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5499999999999996e-06 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263226+0000", 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033532372999999997 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263267+0000", 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1028000000000001e-05 2024-09-14T07:12:26.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263314+0000", 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7494999999999998e-05 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:26.904 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:26.906 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:12:26.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:26.907 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:26.904+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:26.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:26.998 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-14T07:12:27.006 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:27.005+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:27.051 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:27.051 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:27.051 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:27.051 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:27.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:27.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:27.098 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:27.107 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:27.106+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:27.115 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:27.115 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:27.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:27.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:27.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:27.149 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:27.162 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:27.162 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:27.162 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:27.162 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:27.162 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:27.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:27.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:27.166 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:27.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:27.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:27.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:27.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:27.203 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:27.203 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:27.215 INFO:teuthology.orchestra.run.smithi071.stdout:2592 write 0x69f4275 thru 0x69fea4d (0xa7d9 bytes) 2024-09-14T07:12:27.216 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:27.215+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:27.225 INFO:teuthology.orchestra.run.smithi071.stdout:2593 write 0x5a547ef thru 0x5a59be0 (0x53f2 bytes) 2024-09-14T07:12:27.244 INFO:teuthology.orchestra.run.smithi071.stdout:2594 trunc from 0xc46a8b6 to 0x460bc2a 2024-09-14T07:12:27.267 INFO:teuthology.orchestra.run.smithi071.stdout:2595 write 0x553bd57 thru 0x5540ac0 (0x4d6a bytes) 2024-09-14T07:12:27.274 INFO:teuthology.orchestra.run.smithi071.stdout:2596 trunc from 0x5540ac1 to 0x4971de1 2024-09-14T07:12:27.278 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:27.278 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:27.283 INFO:teuthology.orchestra.run.smithi071.stdout:2598 write 0x3b0288b thru 0x3b03205 (0x97b bytes) 2024-09-14T07:12:27.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:27.303 INFO:teuthology.orchestra.run.smithi071.stdout:2599 write 0xe30d0c9 thru 0xe31bc95 (0xebcd bytes) 2024-09-14T07:12:27.308 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:27.306+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:27.309 INFO:teuthology.orchestra.run.smithi071.stdout:2600 write 0x3f1f74c thru 0x3f206f0 (0xfa5 bytes) 2024-09-14T07:12:27.314 INFO:teuthology.orchestra.run.smithi071.stdout:2601 writesame 0x481ebd thru 0x488c62 data_size 0x23(0x6da6 bytes) 2024-09-14T07:12:27.326 INFO:teuthology.orchestra.run.smithi071.stdout:2602 trunc from 0xe31bc96 to 0xd30adf0 2024-09-14T07:12:27.336 INFO:teuthology.orchestra.run.smithi071.stdout:2603 writesame 0x3f72b85 thru 0x3f7a0a9 data_size 0x1(0x7525 bytes) 2024-09-14T07:12:27.349 INFO:teuthology.orchestra.run.smithi071.stdout:2604 read 0x54e2ce thru 0x5589f2 (0xa725 bytes) 2024-09-14T07:12:27.351 INFO:teuthology.orchestra.run.smithi071.stdout:2606 punch from 0x3f12b0f to 0x3f1d78f, (0xac80 bytes) 2024-09-14T07:12:27.351 INFO:teuthology.orchestra.run.smithi071.stdout:2607 write 0x5a22a94 thru 0x5a307f3 (0xdd60 bytes) 2024-09-14T07:12:27.356 INFO:teuthology.orchestra.run.smithi071.stdout:2609 read 0x66875b2 thru 0x6694508 (0xcf57 bytes) 2024-09-14T07:12:27.370 INFO:teuthology.orchestra.run.smithi071.stdout:2612 trunc from 0xd30adf0 to 0x1562441 2024-09-14T07:12:27.409 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:27.408+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:27.415 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:27.416 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:27.417 INFO:teuthology.orchestra.run.smithi071.stdout:2613 writesame 0xb17e39f thru 0xb17e832 data_size 0x2(0x494 bytes) 2024-09-14T07:12:27.417 INFO:teuthology.orchestra.run.smithi071.stdout:2614 punch from 0xcadd0e to 0xcb163c, (0x392e bytes) 2024-09-14T07:12:27.417 INFO:teuthology.orchestra.run.smithi071.stdout:2615 punch from 0xb29595 to 0xb2f39c, (0x5e07 bytes) 2024-09-14T07:12:27.417 INFO:teuthology.orchestra.run.smithi071.stdout:2616 read 0x6d89c95 thru 0x6d8ee4f (0x51bb bytes) 2024-09-14T07:12:27.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:27.430 INFO:teuthology.orchestra.run.smithi071.stdout:2617 trunc from 0xb17e833 to 0x376b53 2024-09-14T07:12:27.461 INFO:teuthology.orchestra.run.smithi071.stdout:2618 punch from 0x213360 to 0x220c2f, (0xd8cf bytes) 2024-09-14T07:12:27.465 INFO:teuthology.orchestra.run.smithi071.stdout:2619 write 0x4594a7 thru 0x45cc29 (0x3783 bytes) 2024-09-14T07:12:27.468 INFO:teuthology.orchestra.run.smithi071.stdout:2620 read 0xc402e thru 0xc61e5 (0x21b8 bytes) 2024-09-14T07:12:27.482 INFO:teuthology.orchestra.run.smithi071.stdout:2621 write 0x729c5da thru 0x72a2805 (0x622c bytes) 2024-09-14T07:12:27.495 INFO:teuthology.orchestra.run.smithi071.stdout:2622 writesame 0xa59e145 thru 0xa5a76f7 data_size 0x1(0x95b3 bytes) 2024-09-14T07:12:27.495 INFO:teuthology.orchestra.run.smithi071.stdout:2624 writesame 0x400c133 thru 0x4013c1c data_size 0x1(0x7aea bytes) 2024-09-14T07:12:27.503 INFO:teuthology.orchestra.run.smithi071.stdout:2625 read 0x119d108 thru 0x11aa1eb (0xd0e4 bytes) 2024-09-14T07:12:27.503 INFO:teuthology.orchestra.run.smithi071.stdout:2626 punch from 0x2f336e0 to 0x2f34e48, (0x1768 bytes) 2024-09-14T07:12:27.509 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:27.509+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:27.513 INFO:teuthology.orchestra.run.smithi071.stdout:2627 writesame 0xdaf023a thru 0xdafca69 data_size 0x8(0xc830 bytes) 2024-09-14T07:12:27.513 INFO:teuthology.orchestra.run.smithi071.stdout:2628 write 0xa89433 thru 0xa91b2e (0x86fc bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2630 read 0x1220810 thru 0x122147a (0xc6b bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2631 read 0x2127d20 thru 0x212ea68 (0x6d49 bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2632 read 0xd173fb8 thru 0xd176a37 (0x2a80 bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2633 read 0x86aaa7e thru 0x86ba329 (0xf8ac bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2634 punch from 0x80499cd to 0x8058dcd, (0xf400 bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2635 read 0x98fa7ed thru 0x9904608 (0x9e1c bytes) 2024-09-14T07:12:27.518 INFO:teuthology.orchestra.run.smithi071.stdout:2637 writesame 0xd8e1f5 thru 0xd96f98 data_size 0x31(0x8da4 bytes) 2024-09-14T07:12:27.522 INFO:teuthology.orchestra.run.smithi071.stdout:2638 write 0x654af1c thru 0x654fda3 (0x4e88 bytes) 2024-09-14T07:12:27.526 INFO:teuthology.orchestra.run.smithi071.stdout:2639 writesame 0x5b80f7c thru 0x5b90f4e data_size 0x1(0xffd3 bytes) 2024-09-14T07:12:27.557 INFO:teuthology.orchestra.run.smithi071.stdout:2640 trunc from 0xdafca6a to 0x128404a 2024-09-14T07:12:27.561 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:27.561 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:27.568 INFO:teuthology.orchestra.run.smithi071.stdout:2641 read 0x70d870 thru 0x70e7ee (0xf7f bytes) 2024-09-14T07:12:27.568 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:27.569 INFO:teuthology.orchestra.run.smithi071.stdout:2643 trunc from 0x128404a to 0x1c7e2e0 2024-09-14T07:12:27.587 INFO:teuthology.orchestra.run.smithi071.stdout:2645 writesame 0x8ed61fc thru 0x8ed9acd data_size 0x7(0x38d2 bytes) 2024-09-14T07:12:27.587 INFO:teuthology.orchestra.run.smithi071.stdout:2646 writesame 0x7491ff6 thru 0x749d30f data_size 0x46(0xb31a bytes) 2024-09-14T07:12:27.595 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.595 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.595 INFO:teuthology.orchestra.run.smithi071.stdout:2650 punch from 0x840e224 to 0x840ed4b, (0xb27 bytes) 2024-09-14T07:12:27.595 INFO:teuthology.orchestra.run.smithi071.stdout:2652 punch from 0x4386b60 to 0x438dced, (0x718d bytes) 2024-09-14T07:12:27.596 INFO:teuthology.orchestra.run.smithi071.stdout:2653 writesame 0x723b75c thru 0x723e1da data_size 0xb(0x2a7f bytes) 2024-09-14T07:12:27.599 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.599 INFO:teuthology.orchestra.run.smithi071.stdout:2655 writesame 0xfdcd5b thru 0xfea4cf data_size 0x1(0xd775 bytes) 2024-09-14T07:12:27.610 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:27.609+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:27.611 INFO:teuthology.orchestra.run.smithi071.stdout:2656 write 0x28081c0 thru 0x280fc40 (0x7a81 bytes) 2024-09-14T07:12:27.616 INFO:teuthology.orchestra.run.smithi071.stdout:2657 write 0x5b9a77 thru 0x5c4248 (0xa7d2 bytes) 2024-09-14T07:12:27.633 INFO:teuthology.orchestra.run.smithi071.stdout:2658 write 0xda6e466 thru 0xda78340 (0x9edb bytes) 2024-09-14T07:12:27.643 INFO:teuthology.orchestra.run.smithi071.stdout:2659 write 0xc84d2a2 thru 0xc850de6 (0x3b45 bytes) 2024-09-14T07:12:27.647 INFO:teuthology.orchestra.run.smithi071.stdout:2660 write 0x55ffd48 thru 0x5607fe3 (0x829c bytes) 2024-09-14T07:12:27.655 INFO:teuthology.orchestra.run.smithi071.stdout:2662 write 0x3fe37f4 thru 0x3ff046d (0xcc7a bytes) 2024-09-14T07:12:27.662 INFO:teuthology.orchestra.run.smithi071.stdout:2663 read 0x3ad2570 thru 0x3ae1a3d (0xf4ce bytes) 2024-09-14T07:12:27.662 INFO:teuthology.orchestra.run.smithi071.stdout:2665 punch from 0xcbd3308 to 0xcbd9fef, (0x6ce7 bytes) 2024-09-14T07:12:27.662 INFO:teuthology.orchestra.run.smithi071.stdout:2667 write 0x9d8ed76 thru 0x9d91172 (0x23fd bytes) 2024-09-14T07:12:27.665 INFO:teuthology.orchestra.run.smithi071.stdout:2668 write 0x47d1f2f thru 0x47d6f65 (0x5037 bytes) 2024-09-14T07:12:27.669 INFO:teuthology.orchestra.run.smithi071.stdout:2669 punch from 0xb9410ce to 0xb94e7ae, (0xd6e0 bytes) 2024-09-14T07:12:27.669 INFO:teuthology.orchestra.run.smithi071.stdout:2670 trunc from 0xda78341 to 0xdc23ecd 2024-09-14T07:12:27.674 INFO:teuthology.orchestra.run.smithi071.stdout:2671 read 0xb60f38f thru 0xb616fc0 (0x7c32 bytes) 2024-09-14T07:12:27.674 INFO:teuthology.orchestra.run.smithi071.stdout:2672 flatten 2024-09-14T07:12:27.697 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.705 INFO:teuthology.orchestra.run.smithi071.stdout:2674 trunc from 0xdc23ecd to 0x69e8514 2024-09-14T07:12:27.711 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:27.709+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:27.715 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:27.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:27.725 INFO:teuthology.orchestra.run.smithi071.stdout:2675 read 0x3641020 thru 0x364dff6 (0xcfd7 bytes) 2024-09-14T07:12:27.755 INFO:teuthology.orchestra.run.smithi071.stdout:2677 read 0x440a0c5 thru 0x440d4e0 (0x341c bytes) 2024-09-14T07:12:27.755 INFO:teuthology.orchestra.run.smithi071.stdout:2678 read 0x2b9ca54 thru 0x2ba9be8 (0xd195 bytes) 2024-09-14T07:12:27.755 INFO:teuthology.orchestra.run.smithi071.stdout:2679 write 0x3fc7576 thru 0x3fd5d63 (0xe7ee bytes) 2024-09-14T07:12:27.758 INFO:teuthology.orchestra.run.smithi071.stdout:2680 punch from 0x25a0a1a to 0x25adc82, (0xd268 bytes) 2024-09-14T07:12:27.758 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.766 INFO:teuthology.orchestra.run.smithi071.stdout:2682 trunc from 0x69e8514 to 0x1261487 2024-09-14T07:12:27.776 INFO:teuthology.orchestra.run.smithi071.stdout:2683 read 0x182ac thru 0x1fc7c (0x79d1 bytes) 2024-09-14T07:12:27.793 INFO:teuthology.orchestra.run.smithi071.stdout:2684 trunc from 0x1261487 to 0xbd751e9 2024-09-14T07:12:27.798 INFO:teuthology.orchestra.run.smithi071.stdout:2685 punch from 0x121d59f to 0x1228ab9, (0xb51a bytes) 2024-09-14T07:12:27.798 INFO:teuthology.orchestra.run.smithi071.stdout:2686 write 0x193b563 thru 0x1941de7 (0x6885 bytes) 2024-09-14T07:12:27.808 INFO:teuthology.orchestra.run.smithi071.stdout:2687 writesame 0x647e5d thru 0x655700 data_size 0x14(0xd8a4 bytes) 2024-09-14T07:12:27.812 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:27.811+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:27.819 INFO:teuthology.orchestra.run.smithi071.stdout:2689 write 0x6a9c3c4 thru 0x6aa9957 (0xd594 bytes) 2024-09-14T07:12:27.825 INFO:teuthology.orchestra.run.smithi071.stderr:set 3.11 pg_upmap_items mapping to [7->4,1->3] 2024-09-14T07:12:27.831 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.832 INFO:teuthology.orchestra.run.smithi071.stdout:2691 read 0x3dbe5ae thru 0x3dc3a87 (0x54da bytes) 2024-09-14T07:12:27.832 INFO:teuthology.orchestra.run.smithi071.stdout:2693 write 0xbc73995 thru 0xbc78f60 (0x55cc bytes) 2024-09-14T07:12:27.837 INFO:teuthology.orchestra.run.smithi071.stdout:2694 read 0x8f42459 thru 0x8f43771 (0x1319 bytes) 2024-09-14T07:12:27.837 INFO:teuthology.orchestra.run.smithi071.stdout:2695 write 0x4f0212e thru 0x4f0fb1b (0xd9ee bytes) 2024-09-14T07:12:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:2696 read 0x14ec09e thru 0x14f4a5b (0x89be bytes) 2024-09-14T07:12:27.847 INFO:teuthology.orchestra.run.smithi071.stdout:2697 read 0xb354499 thru 0xb35d666 (0x91ce bytes) 2024-09-14T07:12:27.848 INFO:teuthology.orchestra.run.smithi071.stdout:2699 write 0x5da554b thru 0x5db2217 (0xcccd bytes) 2024-09-14T07:12:27.857 INFO:teuthology.orchestra.run.smithi071.stdout:2701 write 0x33aa4e3 thru 0x33af35a (0x4e78 bytes) 2024-09-14T07:12:27.861 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:27.861 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:27.862 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.862 INFO:teuthology.orchestra.run.smithi071.stdout:2703 read 0x8b8d44e thru 0x8b91ad0 (0x4683 bytes) 2024-09-14T07:12:27.862 INFO:teuthology.orchestra.run.smithi071.stdout:2704 write 0x511909e thru 0x511cde2 (0x3d45 bytes) 2024-09-14T07:12:27.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:27.873 INFO:teuthology.orchestra.run.smithi071.stdout:2705 trunc from 0xbd751e9 to 0x762064d 2024-09-14T07:12:27.888 INFO:teuthology.orchestra.run.smithi071.stdout:2706 trunc from 0x762064d to 0xc60efe2 2024-09-14T07:12:27.893 INFO:teuthology.orchestra.run.smithi071.stdout:2707 read 0x60c6ea2 thru 0x60ca464 (0x35c3 bytes) 2024-09-14T07:12:27.901 INFO:teuthology.orchestra.run.smithi071.stdout:2708 trunc from 0xc60efe2 to 0x6f71bd9 2024-09-14T07:12:27.913 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:27.912+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:27.915 INFO:teuthology.orchestra.run.smithi071.stdout:2709 trunc from 0x6f71bd9 to 0xe789d35 2024-09-14T07:12:27.921 INFO:teuthology.orchestra.run.smithi071.stdout:2710 writesame 0x446a410 thru 0x44766c3 data_size 0x22(0xc2b4 bytes) 2024-09-14T07:12:27.928 INFO:teuthology.orchestra.run.smithi071.stdout:2711 punch from 0x218172b to 0x218d76a, (0xc03f bytes) 2024-09-14T07:12:27.928 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:27.928 INFO:teuthology.orchestra.run.smithi071.stdout:2714 writesame 0xac7e3e7 thru 0xac80815 data_size 0x1(0x242f bytes) 2024-09-14T07:12:27.934 INFO:teuthology.orchestra.run.smithi071.stdout:2716 writesame 0x4db61f9 thru 0x4dbf38a data_size 0x3(0x9192 bytes) 2024-09-14T07:12:27.942 INFO:teuthology.orchestra.run.smithi071.stdout:2717 punch from 0xe773cff to 0xe780d5f, (0xd060 bytes) 2024-09-14T07:12:27.957 INFO:teuthology.orchestra.run.smithi071.stdout:2718 trunc from 0xe789d35 to 0x173a236 2024-09-14T07:12:27.987 INFO:teuthology.orchestra.run.smithi071.stdout:2719 writesame 0x815b7a8 thru 0x815e938 data_size 0x1(0x3191 bytes) 2024-09-14T07:12:27.988 INFO:teuthology.orchestra.run.smithi071.stdout:2720 trunc from 0x815e939 to 0x7b00b55 2024-09-14T07:12:28.000 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.000 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:2722 writesame 0xc44ce6c thru 0xc451b19 data_size 0x1a(0x4cae bytes) 2024-09-14T07:12:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:2723 read 0x466f0ac thru 0x467a4bd (0xb412 bytes) 2024-09-14T07:12:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:2724 read 0x9c02ade thru 0x9c10a2b (0xdf4e bytes) 2024-09-14T07:12:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:2729 read 0x2ba5a1e thru 0x2bad6cc (0x7caf bytes) 2024-09-14T07:12:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:2730 read 0x34a1044 thru 0x34a13a8 (0x365 bytes) 2024-09-14T07:12:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:2734 writesame 0x23f1ce thru 0x249f67 data_size 0x1b(0xad9a bytes) 2024-09-14T07:12:28.006 INFO:teuthology.orchestra.run.smithi071.stdout:2736 read 0x2b53be1 thru 0x2b59f94 (0x63b4 bytes) 2024-09-14T07:12:28.007 INFO:teuthology.orchestra.run.smithi071.stdout:2737 read 0x65a9e93 thru 0x65b4818 (0xa986 bytes) 2024-09-14T07:12:28.007 INFO:teuthology.orchestra.run.smithi071.stdout:2738 read 0x2ad7903 thru 0x2adc933 (0x5031 bytes) 2024-09-14T07:12:28.007 INFO:teuthology.orchestra.run.smithi071.stdout:2739 write 0x7223bb3 thru 0x7231091 (0xd4df bytes) 2024-09-14T07:12:28.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:28.013 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:28.012+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:28.015 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:28.015 INFO:teuthology.orchestra.run.smithi071.stdout:2742 clone 21 order 20 su 524288 sc 5 2024-09-14T07:12:28.115 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:28.114+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:28.118 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.118 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:28.216 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:28.215+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:28.229 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.230 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:28.317 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:28.315+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:28.381 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.381 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:28.417 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:28.416+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:28.492 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.532 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:28.534 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:28.533+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:28.635 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:28.634+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:28.636 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.636 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:28.736 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:28.735+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:28.788 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.788 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:28.842 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:28.841+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:28.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:12:28.910 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:28.910 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:28.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:28.964 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:28.962+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:29.017 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-14T07:12:29.028 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:29.028 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:29.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:29.078 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:29.077+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:29.140 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:29.139+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:29.179 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:29.179 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:29.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:29.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:29.237 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.237 INFO:teuthology.orchestra.run.smithi071.stdout:2745 writesame 0x46c408c thru 0x46cebcd data_size 0x3(0xab42 bytes) 2024-09-14T07:12:29.241 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:29.240+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:29.262 INFO:teuthology.orchestra.run.smithi071.stdout:2747 trunc from 0xc451b1a to 0x519c284 2024-09-14T07:12:29.276 INFO:teuthology.orchestra.run.smithi071.stdout:2750 read 0x1b65025 thru 0x1b6fe5e (0xae3a bytes) 2024-09-14T07:12:29.293 INFO:teuthology.orchestra.run.smithi071.stdout:2752 writesame 0xd962427 thru 0xd9717df data_size 0x1(0xf3b9 bytes) 2024-09-14T07:12:29.293 INFO:teuthology.orchestra.run.smithi071.stdout:2753 writesame 0x1299161 thru 0x129a988 data_size 0x2(0x1828 bytes) 2024-09-14T07:12:29.293 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:29.294 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:29.296 INFO:teuthology.orchestra.run.smithi071.stdout:2754 write 0xc68328d thru 0xc688414 (0x5188 bytes) 2024-09-14T07:12:29.299 INFO:teuthology.orchestra.run.smithi071.stdout:2755 read 0xc5c48a7 thru 0xc5ca1e4 (0x593e bytes) 2024-09-14T07:12:29.299 INFO:teuthology.orchestra.run.smithi071.stdout:2756 write 0x64a5806 thru 0x64ad740 (0x7f3b bytes) 2024-09-14T07:12:29.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:29.304 INFO:teuthology.orchestra.run.smithi071.stdout:2757 writesame 0xcfc84 thru 0xd3fa7 data_size 0x2(0x4324 bytes) 2024-09-14T07:12:29.316 INFO:teuthology.orchestra.run.smithi071.stdout:2758 punch from 0x7819058 to 0x781e46f, (0x5417 bytes) 2024-09-14T07:12:29.316 INFO:teuthology.orchestra.run.smithi071.stdout:2763 write 0x1ca10c8 thru 0x1caacd6 (0x9c0f bytes) 2024-09-14T07:12:29.322 INFO:teuthology.orchestra.run.smithi071.stdout:2766 writesame 0x8a5baea thru 0x8a6647e data_size 0x1d(0xa995 bytes) 2024-09-14T07:12:29.325 INFO:teuthology.orchestra.run.smithi071.stdout:2767 trunc from 0xd9717e0 to 0xdfaa1e9 2024-09-14T07:12:29.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:29.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:29.346 INFO:teuthology.orchestra.run.smithi071.stdout:2768 trunc from 0xdfaa1e9 to 0xf114de 2024-09-14T07:12:29.347 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:29.345+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:29.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:29.378 INFO:teuthology.orchestra.run.smithi071.stdout:2769 write 0x8f7976f thru 0x8f867a8 (0xd03a bytes) 2024-09-14T07:12:29.381 INFO:teuthology.orchestra.run.smithi071.stdout:2772 writesame 0x88153cf thru 0x881cf27 data_size 0xd(0x7b59 bytes) 2024-09-14T07:12:29.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:29.385 INFO:teuthology.orchestra.run.smithi071.stdout:2773 read 0x1f61525 thru 0x1f68feb (0x7ac7 bytes) 2024-09-14T07:12:29.385 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.390 INFO:teuthology.orchestra.run.smithi071.stdout:2778 trunc from 0x8f867a9 to 0xd6b15c2 2024-09-14T07:12:29.396 INFO:teuthology.orchestra.run.smithi071.stdout:2780 punch from 0x6248460 to 0x624afe8, (0x2b88 bytes) 2024-09-14T07:12:29.396 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.401 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:29.401 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:29.406 INFO:teuthology.orchestra.run.smithi071.stdout:2784 trunc from 0xd6b15c2 to 0x519a8c3 2024-09-14T07:12:29.411 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:29.411 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:29.420 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:29.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:29.423 INFO:teuthology.orchestra.run.smithi071.stdout:2789 write 0x76b6067 thru 0x76be41e (0x83b8 bytes) 2024-09-14T07:12:29.426 INFO:teuthology.orchestra.run.smithi071.stdout:2790 flatten 2024-09-14T07:12:29.442 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:29.441+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:29.444 INFO:teuthology.orchestra.run.smithi071.stdout:2792 write 0x387caa0 thru 0x388a679 (0xdbda bytes) 2024-09-14T07:12:29.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:29.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:29.453 INFO:teuthology.orchestra.run.smithi071.stdout:2793 write 0x7a36796 thru 0x7a3a4bf (0x3d2a bytes) 2024-09-14T07:12:29.456 INFO:teuthology.orchestra.run.smithi071.stdout:2794 read 0x2d5be98 thru 0x2d608c3 (0x4a2c bytes) 2024-09-14T07:12:29.456 INFO:teuthology.orchestra.run.smithi071.stdout:2795 read 0x56fd7da thru 0x5700796 (0x2fbd bytes) 2024-09-14T07:12:29.456 INFO:teuthology.orchestra.run.smithi071.stdout:2796 read 0x4a555ee thru 0x4a57131 (0x1b44 bytes) 2024-09-14T07:12:29.456 INFO:teuthology.orchestra.run.smithi071.stdout:2801 writesame 0x74376b7 thru 0x74394ec data_size 0x3(0x1e36 bytes) 2024-09-14T07:12:29.463 INFO:teuthology.orchestra.run.smithi071.stdout:2802 trunc from 0x7a3a4c0 to 0x2f82401 2024-09-14T07:12:29.464 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:29.464 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:29.467 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:29.467 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:29.473 INFO:teuthology.orchestra.run.smithi071.stdout:2804 read 0xc0f457 thru 0xc0f5e4 (0x18e bytes) 2024-09-14T07:12:29.483 INFO:teuthology.orchestra.run.smithi071.stdout:2805 write 0x723c947 thru 0x7243888 (0x6f42 bytes) 2024-09-14T07:12:29.485 INFO:teuthology.orchestra.run.smithi071.stdout:2807 write 0x1dadbc6 thru 0x1dae254 (0x68f bytes) 2024-09-14T07:12:29.488 INFO:teuthology.orchestra.run.smithi071.stdout:2808 write 0x1921638 thru 0x192433b (0x2d04 bytes) 2024-09-14T07:12:29.491 INFO:teuthology.orchestra.run.smithi071.stdout:2809 write 0x3a66e77 thru 0x3a7442c (0xd5b6 bytes) 2024-09-14T07:12:29.495 INFO:teuthology.orchestra.run.smithi071.stdout:2810 trunc from 0x7243889 to 0x5ff8200 2024-09-14T07:12:29.507 INFO:teuthology.orchestra.run.smithi071.stdout:2811 write 0x2822b8d thru 0x2829e91 (0x7305 bytes) 2024-09-14T07:12:29.514 INFO:teuthology.orchestra.run.smithi071.stdout:2812 trunc from 0x5ff8200 to 0x1ebe7b2 2024-09-14T07:12:29.524 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.524 INFO:teuthology.orchestra.run.smithi071.stdout:2814 writesame 0xa1b5da thru 0xa237b6 data_size 0x5(0x81dd bytes) 2024-09-14T07:12:29.543 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:29.542+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:29.546 INFO:teuthology.orchestra.run.smithi071.stdout:2816 writesame 0xba77696 thru 0xba7961f data_size 0xb(0x1f8a bytes) 2024-09-14T07:12:29.546 INFO:teuthology.orchestra.run.smithi071.stdout:2817 read 0x92886b8 thru 0x928cf41 (0x488a bytes) 2024-09-14T07:12:29.546 INFO:teuthology.orchestra.run.smithi071.stdout:2818 read 0x4909176 thru 0x490a9f1 (0x187c bytes) 2024-09-14T07:12:29.546 INFO:teuthology.orchestra.run.smithi071.stdout:2819 read 0x9280858 thru 0x928c2ae (0xba57 bytes) 2024-09-14T07:12:29.546 INFO:teuthology.orchestra.run.smithi071.stdout:2820 write 0x49cbe8d thru 0x49d45a8 (0x871c bytes) 2024-09-14T07:12:29.548 INFO:teuthology.orchestra.run.smithi071.stdout:2821 writesame 0x7b880a2 thru 0x7b956f8 data_size 0x1(0xd657 bytes) 2024-09-14T07:12:29.569 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:29.569 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:29.569 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:29.576 INFO:teuthology.orchestra.run.smithi071.stdout:2822 read 0xb701a3f thru 0xb70e6c3 (0xcc85 bytes) 2024-09-14T07:12:29.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:29.583 INFO:teuthology.orchestra.run.smithi071.stdout:2823 write 0xd2ad1d3 thru 0xd2b8291 (0xb0bf bytes) 2024-09-14T07:12:29.586 INFO:teuthology.orchestra.run.smithi071.stdout:2824 write 0x31fbaed thru 0x32070f5 (0xb609 bytes) 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:2825 punch from 0x6c65b21 to 0x6c66be0, (0x10bf bytes) 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:2830 read 0x57faa56 thru 0x5808763 (0xdd0e bytes) 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:2833 punch from 0x12b5c5d to 0x12c34f0, (0xd893 bytes) 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:2834 read 0x17ed8b7 thru 0x17f7468 (0x9bb2 bytes) 2024-09-14T07:12:29.590 INFO:teuthology.orchestra.run.smithi071.stdout:2836 write 0x6fc7492 thru 0x6fc9de3 (0x2952 bytes) 2024-09-14T07:12:29.592 INFO:teuthology.orchestra.run.smithi071.stdout:2837 write 0x4dc1158 thru 0x4dccdbc (0xbc65 bytes) 2024-09-14T07:12:29.601 INFO:teuthology.orchestra.run.smithi071.stdout:2838 trunc from 0xd2b8292 to 0x8c9fc8e 2024-09-14T07:12:29.609 INFO:teuthology.orchestra.run.smithi071.stdout:2839 read 0x645fa4a thru 0x646bd96 (0xc34d bytes) 2024-09-14T07:12:29.611 INFO:teuthology.orchestra.run.smithi071.stdout:2840 trunc from 0x8c9fc8e to 0x9c82ead 2024-09-14T07:12:29.625 INFO:teuthology.orchestra.run.smithi071.stdout:2841 write 0xd1f7092 thru 0xd201437 (0xa3a6 bytes) 2024-09-14T07:12:29.629 INFO:teuthology.orchestra.run.smithi071.stdout:2842 read 0xa42dc50 thru 0xa43931d (0xb6ce bytes) 2024-09-14T07:12:29.629 INFO:teuthology.orchestra.run.smithi071.stdout:2844 write 0x5c35b6 thru 0x5c8bfb (0x5646 bytes) 2024-09-14T07:12:29.630 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.644 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:29.644+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:29.645 INFO:teuthology.orchestra.run.smithi071.stdout:2846 trunc from 0xd201438 to 0x8b6bbb 2024-09-14T07:12:29.658 INFO:teuthology.orchestra.run.smithi071.stdout:2847 trunc from 0x8b6bbb to 0x5f03d2 2024-09-14T07:12:29.666 INFO:teuthology.orchestra.run.smithi071.stdout:2848 punch from 0x594446 to 0x59df5d, (0x9b17 bytes) 2024-09-14T07:12:29.666 INFO:teuthology.orchestra.run.smithi071.stdout:2850 read 0x5a9385 thru 0x5b2452 (0x90ce bytes) 2024-09-14T07:12:29.681 INFO:teuthology.orchestra.run.smithi071.stdout:2853 write 0x82a6168 thru 0x82ad99c (0x7835 bytes) 2024-09-14T07:12:29.686 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:9449 3.a 3:56e24ad3:::rbd_data.1182b13d849f.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 18850559~65145] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.616616229999998, 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.039129075999999999, 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 9449 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068070+0000", 2024-09-14T07:12:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.068072+0000", 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1220000000000002e-06 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082261+0000", 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014189286000000001 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082289+0000", 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8123000000000002e-05 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082307+0000", 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7864e-05 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082406+0000", 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9223999999999997e-05 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.082564+0000", 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015800499999999999 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.083260+0000", 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069602200000000003 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.106367+0000", 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023106318000000001 2024-09-14T07:12:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107084+0000", 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000717036 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107149+0000", 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5581999999999997e-05 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:04.107199+0000", 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9493999999999997e-05 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.8278750400000003, 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:12:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:12:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:12:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48351 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 16515072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.228964+0000", 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4557216410000002, 2024-09-14T07:12:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030658991999999999, 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48351 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228964+0000", 2024-09-14T07:12:29.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228964+0000", 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228965+0000", 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228966+0000", 2024-09-14T07:12:29.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.753e-06 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228972+0000", 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8220000000000003e-06 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.228977+0000", 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.498e-06 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259525+0000", 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030548128000000001 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259570+0000", 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5129000000000001e-05 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259623+0000", 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3310000000000003e-05 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.704 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48375 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 1703936~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229039+0000", 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4556465080000001, 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031125238, 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48375 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229039+0000", 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229039+0000", 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229040+0000", 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3099999999999997e-07 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229043+0000", 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.241e-06 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229051+0000", 2024-09-14T07:12:29.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.374e-06 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229056+0000", 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259672+0000", 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.030616606000000001 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.259734+0000", 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1563999999999995e-05 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260165+0000", 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00043061199999999998 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48376 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 3670016~6815] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229064+0000", 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4556215479999999, 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031535727, 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48376 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229064+0000", 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229064+0000", 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229065+0000", 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:29.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229072+0000", 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3420000000000002e-06 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229078+0000", 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2940000000000002e-06 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229085+0000", 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6170000000000003e-06 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260208+0000", 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031123293 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260283+0000", 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4300000000000004e-05 2024-09-14T07:12:29.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260600+0000", 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031748099999999999 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48377 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4555882540000002, 2024-09-14T07:12:29.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031659055999999998, 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48377 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229098+0000", 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4799999999999998e-07 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229100+0000", 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0710000000000002e-06 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229106+0000", 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2319999999999998e-06 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229113+0000", 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1369999999999999e-06 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260639+0000", 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031525985999999999 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260688+0000", 2024-09-14T07:12:29.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9172000000000003e-05 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260757+0000", 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8910000000000003e-05 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48378 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4555652270000001, 2024-09-14T07:12:29.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031840194000000002, 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48378 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:29.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229121+0000", 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6199999999999998e-07 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229123+0000", 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.796e-06 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229129+0000", 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8749999999999997e-06 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229139+0000", 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0030000000000001e-05 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260795+0000", 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031656419999999998 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260868+0000", 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3013e-05 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260961+0000", 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2597999999999997e-05 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48379 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 9043968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4555403260000004, 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031949770000000002, 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48379 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229146+0000", 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7599999999999998e-07 2024-09-14T07:12:29.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229148+0000", 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229154+0000", 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6470000000000001e-06 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229159+0000", 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6299999999999997e-06 2024-09-14T07:12:29.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.260996+0000", 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031836510999999998 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261039+0000", 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3421999999999999e-05 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261095+0000", 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6288e-05 2024-09-14T07:12:29.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48380 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 11010048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4555199779999999, 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032123634999999998, 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48380 2024-09-14T07:12:29.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229166+0000", 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1399999999999998e-07 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229168+0000", 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.584e-06 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229173+0000", 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3009999999999997e-06 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229178+0000", 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2510000000000002e-06 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261128+0000", 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.031949970000000001 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261204+0000", 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5254999999999997e-05 2024-09-14T07:12:29.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261290+0000", 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5959999999999997e-05 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48381 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 12713984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4554983249999998, 2024-09-14T07:12:29.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032214700999999998, 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48381 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229188+0000", 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229190+0000", 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0640000000000001e-06 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229196+0000", 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9830000000000001e-06 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229206+0000", 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8439999999999993e-06 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261316+0000", 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032110412999999997 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261354+0000", 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7935000000000002e-05 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261402+0000", 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8102000000000001e-05 2024-09-14T07:12:29.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48382 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 14680064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4554530080000001, 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.03235946, 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48382 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229233+0000", 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229236+0000", 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.199e-06 2024-09-14T07:12:29.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229242+0000", 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5490000000000003e-06 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229247+0000", 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7709999999999997e-06 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261435+0000", 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032187597999999998 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261507+0000", 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2169000000000006e-05 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261592+0000", 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5612000000000006e-05 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.741 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48383 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 16646144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4554323680000003, 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032437607, 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.742 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48383 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229254+0000", 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5299999999999999e-07 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229256+0000", 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7850000000000001e-06 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229261+0000", 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.733e-06 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229266+0000", 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.578e-06 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261607+0000", 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032341038000000003 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261644+0000", 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7392999999999999e-05 2024-09-14T07:12:29.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261691+0000", 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6626999999999999e-05 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48407 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 1835008~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229504+0000", 2024-09-14T07:12:29.746 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4551816239999997, 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032756399999999998, 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48407 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229504+0000", 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229504+0000", 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229505+0000", 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9400000000000004e-07 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229508+0000", 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1879999999999998e-06 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229517+0000", 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1500000000000005e-06 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229523+0000", 2024-09-14T07:12:29.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.48e-06 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261721+0000", 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032198348000000002 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.261793+0000", 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1414000000000004e-05 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262261+0000", 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00046802600000000002 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48408 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229533+0000", 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4551524850000002, 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032883879999999997, 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48408 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229533+0000", 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229533+0000", 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229534+0000", 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3000000000000001e-07 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229536+0000", 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.193e-06 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229542+0000", 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3770000000000001e-06 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229547+0000", 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8570000000000003e-06 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262294+0000", 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032746535 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262352+0000", 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8068e-05 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262417+0000", 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5320000000000005e-05 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48409 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:29.755 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4551323509999996, 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033055492999999998, 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48409 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:29.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229554+0000", 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2500000000000001e-07 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229556+0000", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.708e-06 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229561+0000", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6069999999999998e-06 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229565+0000", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3229999999999999e-06 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262450+0000", 2024-09-14T07:12:29.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.032884871000000003 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262524+0000", 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3440000000000002e-05 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262609+0000", 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5218999999999998e-05 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.759 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48410 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.455114375, 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033170810000000002, 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48410 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229572+0000", 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229579+0000", 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.571e-06 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229586+0000", 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9229999999999996e-06 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229595+0000", 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1470000000000007e-06 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262639+0000", 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033043425000000001 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262687+0000", 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8479000000000001e-05 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262742+0000", 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4957999999999998e-05 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48411 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 9175040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229602+0000", 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4550834620000002, 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033277501000000001, 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.764 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48411 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229602+0000", 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229602+0000", 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229603+0000", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7800000000000002e-07 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229611+0000", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2020000000000004e-06 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229617+0000", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2190000000000001e-06 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229622+0000", 2024-09-14T07:12:29.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7679999999999999e-06 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262780+0000", 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033158172 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262828+0000", 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7815999999999998e-05 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262880+0000", 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1946e-05 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.767 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48412 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 11141120~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4550570939999998, 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033383283999999999, 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48412 2024-09-14T07:12:29.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229629+0000", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6100000000000002e-07 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229631+0000", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.773e-06 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229637+0000", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8549999999999998e-06 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229641+0000", 2024-09-14T07:12:29.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5900000000000001e-06 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262915+0000", 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033273502000000003 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.262951+0000", 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6297999999999997e-05 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263012+0000", 2024-09-14T07:12:29.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0905e-05 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48413 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 12845056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4550260970000002, 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033548144000000002, 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48413 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229660+0000", 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7999999999999995e-07 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229663+0000", 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9469999999999999e-06 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229670+0000", 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5930000000000002e-06 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229675+0000", 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263049+0000", 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033374643000000002 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263120+0000", 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0828999999999996e-05 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263208+0000", 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7733999999999997e-05 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:48414 3.1e 3:78a5fb0b:::rbd_data.1182767cf9bf.0000000000000000:15 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:25.229681+0000", 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.4550047749999999, 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033633070000000001, 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:29.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 48414 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229681+0000", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229681+0000", 2024-09-14T07:12:29.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229682+0000", 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1699999999999999e-07 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229683+0000", 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.649e-06 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229689+0000", 2024-09-14T07:12:29.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.558e-06 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.229693+0000", 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5499999999999996e-06 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263226+0000", 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.033532372999999997 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:29.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263267+0000", 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1028000000000001e-05 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:25.263314+0000", 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7494999999999998e-05 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:29.780 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:29.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:29.783 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:29.781+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:2856 trunc from 0x82ad99d to 0xd81df5c 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:2857 read 0x49acb2e thru 0x49ad5cd (0xaa0 bytes) 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:2858 read 0xd0c06a7 thru 0xd0c16d0 (0x102a bytes) 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:2859 trunc from 0xd81df5c to 0x9b9604d 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:2861 read 0x65cfdf3 thru 0x65d2f4d (0x315b bytes) 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:2862 writesame 0x430be01 thru 0x4310d8b data_size 0x1(0x4f8b bytes) 2024-09-14T07:12:29.784 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2864 write 0xbeda6d thru 0xbf8547 (0xaadb bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2865 write 0xe75d7d1 thru 0xe762938 (0x5168 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2866 writesame 0xa3298ec thru 0xa335b5a data_size 0x37(0xc26f bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2867 trunc from 0xe762939 to 0xca14b7c 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2868 write 0xb71f4f3 thru 0xb71fdf1 (0x8ff bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2869 write 0x72eed3b thru 0x72f55aa (0x6870 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2870 write 0x4fe5e28 thru 0x4fe6b0f (0xce8 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2871 writesame 0x94ae5fe thru 0x94b21f1 data_size 0x6(0x3bf4 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2873 punch from 0x1365309 to 0x1374af0, (0xf7e7 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2875 writesame 0xe1d65d8 thru 0xe1dbd5e data_size 0x4d(0x5787 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2876 writesame 0x10166f8 thru 0x1022f0a data_size 0x3f(0xc813 bytes) 2024-09-14T07:12:29.785 INFO:teuthology.orchestra.run.smithi071.stdout:2877 clone 22 order 20 su 65536 sc 15 2024-09-14T07:12:29.839 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:12:29.895 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:29.894+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:29.929 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:29.929 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:29.929 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:29.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:29.984 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:29.983+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:30.024 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-14T07:12:30.041 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:30.041 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:30.041 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:30.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:30.091 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:30.090+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:30.186 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:30.185+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:30.193 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:30.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.057176198000001, 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:30.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:30.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:30.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.501859675999999, 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:30.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:30.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281586779, 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:12:30.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:12:30.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281565088000001, 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:12:30.211 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:12:30.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:12:30.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281545185000001, 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:12:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281523691, 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:12:30.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.224 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.28150537, 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.225 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:12:30.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.229 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281479027, 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:12:30.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281458561999999, 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:30.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:30.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:12:30.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281436706999999, 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:12:30.239 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:30.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:12:30.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281418071999999, 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.248 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281391931, 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:12:30.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281364413, 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.253 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:12:30.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281346934, 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.258 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:30.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.262 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.281334817999999, 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:12:30.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.275892799999999, 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.267 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:12:30.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.275873475999999, 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.275844626, 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:12:30.276 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:12:30.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.280 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.275804102, 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:12:30.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.285 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.275782077000001, 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:12:30.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:12:30.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:30.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:30.290 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:30.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:30.293 INFO:teuthology.orchestra.run.smithi071.stdout:2878 read 0x3a08faf thru 0x3a12983 (0x99d5 bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2879 read 0x9069bd4 thru 0x90734b1 (0x98de bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2880 punch from 0xbd8977d to 0xbd8c515, (0x2d98 bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2882 read 0x7881c46 thru 0x788fa03 (0xddbe bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2883 write 0x504207e thru 0x504a7c2 (0x8745 bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2884 read 0x5f357f7 thru 0x5f455a6 (0xfdb0 bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2885 punch from 0x5a5a94e to 0x5a67b25, (0xd1d7 bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2886 read 0x1622fb3 thru 0x1623f8e (0xfdc bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2888 write 0x54ae087 thru 0x54b8b20 (0xaa9a bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2890 read 0xdc2bc2b thru 0xdc39f1d (0xe2f3 bytes) 2024-09-14T07:12:30.294 INFO:teuthology.orchestra.run.smithi071.stdout:2891 writesame 0x4f1d39f thru 0x4f24102 data_size 0x2(0x6d64 bytes) 2024-09-14T07:12:30.295 INFO:teuthology.orchestra.run.smithi071.stdout:2892 write 0x3956121 thru 0x395ae63 (0x4d43 bytes) 2024-09-14T07:12:30.295 INFO:teuthology.orchestra.run.smithi071.stdout:2893 write 0x6483f2 thru 0x649f2e (0x1b3d bytes) 2024-09-14T07:12:30.295 INFO:teuthology.orchestra.run.smithi071.stdout:2894 write 0x45af6ca thru 0x45b4705 (0x503c bytes) 2024-09-14T07:12:30.295 INFO:teuthology.orchestra.run.smithi071.stdout:2895 writesame 0xa4350c9 thru 0xa441450 data_size 0x4(0xc388 bytes) 2024-09-14T07:12:30.295 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:30.290+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:30.296 INFO:teuthology.orchestra.run.smithi071.stdout:2896 write 0xc7b7cbe thru 0xc7bb2f2 (0x3635 bytes) 2024-09-14T07:12:30.303 INFO:teuthology.orchestra.run.smithi071.stdout:2897 trunc from 0xe1dbd5f to 0x7af06c4 2024-09-14T07:12:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:2899 punch from 0x46416f9 to 0x4641d6f, (0x676 bytes) 2024-09-14T07:12:30.333 INFO:teuthology.orchestra.run.smithi071.stdout:2900 writesame 0x347f515 thru 0x348010d data_size 0x1(0xbf9 bytes) 2024-09-14T07:12:30.336 INFO:teuthology.orchestra.run.smithi071.stdout:2901 read 0x3795d8f thru 0x3799ce4 (0x3f56 bytes) 2024-09-14T07:12:30.336 INFO:teuthology.orchestra.run.smithi071.stdout:2903 write 0x238bc41 thru 0x2390b3f (0x4eff bytes) 2024-09-14T07:12:30.339 INFO:teuthology.orchestra.run.smithi071.stdout:2904 read 0x565e121 thru 0x566d045 (0xef25 bytes) 2024-09-14T07:12:30.339 INFO:teuthology.orchestra.run.smithi071.stdout:2905 write 0x687ba28 thru 0x68836a4 (0x7c7d bytes) 2024-09-14T07:12:30.348 INFO:teuthology.orchestra.run.smithi071.stdout:2906 trunc from 0x7af06c4 to 0xcba3866 2024-09-14T07:12:30.359 INFO:teuthology.orchestra.run.smithi071.stdout:2907 write 0xcf45e48 thru 0xcf5350c (0xd6c5 bytes) 2024-09-14T07:12:30.367 INFO:teuthology.orchestra.run.smithi071.stdout:2908 trunc from 0xcf5350d to 0x9b95b93 2024-09-14T07:12:30.380 INFO:teuthology.orchestra.run.smithi071.stdout:2909 punch from 0xb78c30 to 0xb884da, (0xf8aa bytes) 2024-09-14T07:12:30.380 INFO:teuthology.orchestra.run.smithi071.stdout:2910 read 0xa9b48 thru 0xb64ad (0xc966 bytes) 2024-09-14T07:12:30.389 INFO:teuthology.orchestra.run.smithi071.stdout:2911 write 0xbe1dd07 thru 0xbe2c523 (0xe81d bytes) 2024-09-14T07:12:30.392 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:30.391+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:30.394 INFO:teuthology.orchestra.run.smithi071.stdout:2912 read 0x393bc8d thru 0x39485ca (0xc93e bytes) 2024-09-14T07:12:30.394 INFO:teuthology.orchestra.run.smithi071.stdout:2913 read 0x3f55815 thru 0x3f56016 (0x802 bytes) 2024-09-14T07:12:30.395 INFO:teuthology.orchestra.run.smithi071.stdout:2914 read 0x53812ad thru 0x5390502 (0xf256 bytes) 2024-09-14T07:12:30.399 INFO:teuthology.orchestra.run.smithi071.stdout:2915 trunc from 0xbe2c524 to 0x824fd85 2024-09-14T07:12:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:2916 trunc from 0x824fd85 to 0x952f9eb 2024-09-14T07:12:30.413 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:30.413 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:30.413 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:30.413 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:30.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:30.425 INFO:teuthology.orchestra.run.smithi071.stdout:2917 write 0xb8beb07 thru 0xb8c7442 (0x893c bytes) 2024-09-14T07:12:30.428 INFO:teuthology.orchestra.run.smithi071.stdout:2918 read 0xb01ff5 thru 0xb0aea6 (0x8eb2 bytes) 2024-09-14T07:12:30.428 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.428 INFO:teuthology.orchestra.run.smithi071.stdout:2920 read 0x17f1d08 thru 0x17f5a7c (0x3d75 bytes) 2024-09-14T07:12:30.429 INFO:teuthology.orchestra.run.smithi071.stdout:2921 punch from 0x2aee7e0 to 0x2af725a, (0x8a7a bytes) 2024-09-14T07:12:30.434 INFO:teuthology.orchestra.run.smithi071.stdout:2922 write 0xe41d770 thru 0xe424a5f (0x72f0 bytes) 2024-09-14T07:12:30.437 INFO:teuthology.orchestra.run.smithi071.stdout:2923 read 0xe02635f thru 0xe033937 (0xd5d9 bytes) 2024-09-14T07:12:30.437 INFO:teuthology.orchestra.run.smithi071.stdout:2926 write 0x5111284 thru 0x51170ac (0x5e29 bytes) 2024-09-14T07:12:30.441 INFO:teuthology.orchestra.run.smithi071.stdout:2927 punch from 0x879b6a4 to 0x87a3cb7, (0x8613 bytes) 2024-09-14T07:12:30.441 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.441 INFO:teuthology.orchestra.run.smithi071.stdout:2929 punch from 0xa0a46af to 0xa0a9154, (0x4aa5 bytes) 2024-09-14T07:12:30.445 INFO:teuthology.orchestra.run.smithi071.stdout:2930 write 0xe99c734 thru 0xe99ec5a (0x2527 bytes) 2024-09-14T07:12:30.447 INFO:teuthology.orchestra.run.smithi071.stdout:2931 read 0x2de3b40 thru 0x2de601a (0x24db bytes) 2024-09-14T07:12:30.447 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.447 INFO:teuthology.orchestra.run.smithi071.stdout:2933 write 0x547c871 thru 0x547cf3e (0x6ce bytes) 2024-09-14T07:12:30.455 INFO:teuthology.orchestra.run.smithi071.stdout:2934 trunc from 0xe99ec5b to 0xab7a13a 2024-09-14T07:12:30.464 INFO:teuthology.orchestra.run.smithi071.stdout:2935 write 0xa371361 thru 0xa37f70e (0xe3ae bytes) 2024-09-14T07:12:30.466 INFO:teuthology.orchestra.run.smithi071.stdout:2936 read 0x46c3e6f thru 0x46ce84c (0xa9de bytes) 2024-09-14T07:12:30.466 INFO:teuthology.orchestra.run.smithi071.stdout:2937 read 0x84c8793 thru 0x84cb5aa (0x2e18 bytes) 2024-09-14T07:12:30.467 INFO:teuthology.orchestra.run.smithi071.stdout:2938 punch from 0x251f4e6 to 0x2526056, (0x6b70 bytes) 2024-09-14T07:12:30.476 INFO:teuthology.orchestra.run.smithi071.stdout:2939 trunc from 0xab7a13a to 0x30af53e 2024-09-14T07:12:30.493 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:30.492+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:30.512 INFO:teuthology.orchestra.run.smithi071.stdout:2940 trunc from 0x30af53e to 0xce8e3a5 2024-09-14T07:12:30.517 INFO:teuthology.orchestra.run.smithi071.stdout:2941 writesame 0x4295140 thru 0x429ff80 data_size 0x1(0xae41 bytes) 2024-09-14T07:12:30.534 INFO:teuthology.orchestra.run.smithi071.stdout:2942 write 0x350d1d1 thru 0x3512278 (0x50a8 bytes) 2024-09-14T07:12:30.535 INFO:teuthology.orchestra.run.smithi071.stdout:2943 write 0xab448bb thru 0xab4a387 (0x5acd bytes) 2024-09-14T07:12:30.538 INFO:teuthology.orchestra.run.smithi071.stdout:2944 write 0x4075324 thru 0x407f506 (0xa1e3 bytes) 2024-09-14T07:12:30.542 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.547 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:30.547 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:30.550 INFO:teuthology.orchestra.run.smithi071.stdout:2948 write 0xda311f8 thru 0xda3b966 (0xa76f bytes) 2024-09-14T07:12:30.552 INFO:teuthology.orchestra.run.smithi071.stdout:2949 punch from 0xa7c80cc to 0xa7d76b7, (0xf5eb bytes) 2024-09-14T07:12:30.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:30.560 INFO:teuthology.orchestra.run.smithi071.stdout:2951 trunc from 0xda3b967 to 0x75ae40a 2024-09-14T07:12:30.574 INFO:teuthology.orchestra.run.smithi071.stdout:2953 trunc from 0x75ae40a to 0x3a1f229 2024-09-14T07:12:30.589 INFO:teuthology.orchestra.run.smithi071.stdout:2954 read 0x2487c39 thru 0x24958f7 (0xdcbf bytes) 2024-09-14T07:12:30.590 INFO:teuthology.orchestra.run.smithi071.stdout:2956 read 0x289b074 thru 0x289f062 (0x3fef bytes) 2024-09-14T07:12:30.594 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:30.593+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:30.606 INFO:teuthology.orchestra.run.smithi071.stdout:2957 write 0xc6c109e thru 0xc6cf0ca (0xe02d bytes) 2024-09-14T07:12:30.608 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.609 INFO:teuthology.orchestra.run.smithi071.stdout:2959 write 0xc0198b4 thru 0xc01bf48 (0x2695 bytes) 2024-09-14T07:12:30.614 INFO:teuthology.orchestra.run.smithi071.stdout:2960 write 0x2da300c thru 0x2da793a (0x492f bytes) 2024-09-14T07:12:30.616 INFO:teuthology.orchestra.run.smithi071.stdout:2961 trunc from 0xc6cf0cb to 0xb39c28d 2024-09-14T07:12:30.625 INFO:teuthology.orchestra.run.smithi071.stdout:2963 read 0x66ae6f1 thru 0x66b92cf (0xabdf bytes) 2024-09-14T07:12:30.625 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.625 INFO:teuthology.orchestra.run.smithi071.stdout:2966 writesame 0xa21a3bd thru 0xa21ed65 data_size 0x1(0x49a9 bytes) 2024-09-14T07:12:30.635 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.635 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.635 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.635 INFO:teuthology.orchestra.run.smithi071.stdout:2977 write 0x3d2484c thru 0x3d25928 (0x10dd bytes) 2024-09-14T07:12:30.638 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.638 INFO:teuthology.orchestra.run.smithi071.stdout:2980 punch from 0x5780336 to 0x5786ae6, (0x67b0 bytes) 2024-09-14T07:12:30.638 INFO:teuthology.orchestra.run.smithi071.stdout:2982 read 0x3d60268 thru 0x3d6b0d2 (0xae6b bytes) 2024-09-14T07:12:30.638 INFO:teuthology.orchestra.run.smithi071.stdout:2984 read 0x9acea10 thru 0x9ad6086 (0x7677 bytes) 2024-09-14T07:12:30.649 INFO:teuthology.orchestra.run.smithi071.stdout:2985 trunc from 0xb39c28d to 0x18904f4 2024-09-14T07:12:30.674 INFO:teuthology.orchestra.run.smithi071.stdout:2986 read 0xda46fe thru 0xdb2ea5 (0xe7a8 bytes) 2024-09-14T07:12:30.682 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20787 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1036288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819394478, 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073802193000000002, 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20787 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861518+0000", 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861524+0000", 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861529+0000", 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3719999999999998e-06 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935021+0000", 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073492476000000001 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935106+0000", 2024-09-14T07:12:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5463999999999994e-05 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935318+0000", 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211623 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20788 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819376919, 2024-09-14T07:12:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07400669, 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20788 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861534+0000", 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861540+0000", 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9309999999999996e-06 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861543+0000", 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861546+0000", 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935348+0000", 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073801781999999996 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935423+0000", 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5080000000000006e-05 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935540+0000", 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011749899999999999 2024-09-14T07:12:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20798 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 528384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819361182, 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231058000000003, 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20798 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861550+0000", 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.017e-06 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861553+0000", 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.909e-06 2024-09-14T07:12:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861559+0000", 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935582+0000", 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074022663000000002 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935663+0000", 2024-09-14T07:12:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1865000000000003e-05 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935780+0000", 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011686 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20799 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819344773999999, 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074466447000000005, 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20799 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861567+0000", 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861572+0000", 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9609999999999996e-06 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861576+0000", 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935808+0000", 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231973000000007 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935878+0000", 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0143999999999998e-05 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936032+0000", 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153774 2024-09-14T07:12:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20800 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819328198999999, 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074574472000000003, 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20800 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861584+0000", 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7940000000000001e-06 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861596+0000", 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2092e-05 2024-09-14T07:12:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861602+0000", 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936049+0000", 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074446734000000001 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936091+0000", 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1947999999999999e-05 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936157+0000", 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5569999999999997e-05 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20801 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 868352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819302458999999, 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07473929, 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20801 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7500000000000001e-07 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861610+0000", 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.378e-06 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861614+0000", 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1459999999999998e-06 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861616+0000", 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.43e-06 2024-09-14T07:12:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936172+0000", 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074555621000000002 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936210+0000", 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8260000000000003e-05 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936347+0000", 2024-09-14T07:12:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013718000000000001 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20802 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 643072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819291011000001, 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075010695000000002, 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20802 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7700000000000003e-07 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861625+0000", 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8169999999999998e-06 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861629+0000", 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8550000000000004e-06 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936409+0000", 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074779656 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936501+0000", 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1933000000000002e-05 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936630+0000", 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129336 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20803 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 925696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819275595000001, 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075273382, 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20803 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.03e-07 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861637+0000", 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.703e-06 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861642+0000", 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3990000000000003e-06 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861653+0000", 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0638999999999999e-05 2024-09-14T07:12:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936659+0000", 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075006286000000005 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936700+0000", 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0649000000000003e-05 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936908+0000", 2024-09-14T07:12:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020830299999999999 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20804 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 700416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819250686, 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505252999999994, 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20804 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6499999999999999e-07 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861662+0000", 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2589999999999999e-06 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861668+0000", 2024-09-14T07:12:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1070000000000001e-06 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861673+0000", 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4909999999999999e-06 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936955+0000", 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075281854999999995 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937041+0000", 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5783000000000002e-05 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937165+0000", 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012429300000000001 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20805 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 983040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819231104, 2024-09-14T07:12:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075862623000000004, 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20805 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861680+0000", 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861682+0000", 2024-09-14T07:12:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861687+0000", 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861692+0000", 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4270000000000001e-06 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937197+0000", 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505371000000002 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937280+0000", 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2848000000000004e-05 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937542+0000", 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000261826 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20806 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 757760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819212396999999, 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076006066999999997, 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20806 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861700+0000", 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5600000000000001e-06 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861705+0000", 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0760000000000002e-06 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861709+0000", 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3499999999999999e-06 2024-09-14T07:12:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937567+0000", 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075857407000000002 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937627+0000", 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0457000000000001e-05 2024-09-14T07:12:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937704+0000", 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6872000000000005e-05 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20807 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819195762, 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076214191000000001, 2024-09-14T07:12:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20807 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861717+0000", 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861722+0000", 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861733+0000", 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0898e-05 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937724+0000", 2024-09-14T07:12:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075991264000000003 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937770+0000", 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5809000000000001e-05 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937929+0000", 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158651 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20817 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819172644, 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076617540999999997, 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20817 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9700000000000003e-07 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861745+0000", 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1520000000000003e-06 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861749+0000", 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6030000000000001e-06 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861751+0000", 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4509999999999999e-06 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937964+0000", 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076212703000000007 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938051+0000", 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6681999999999994e-05 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938355+0000", 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000304653 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20818 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819155865999999, 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076901419999999998, 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20818 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861755+0000", 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861756+0000", 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861758+0000", 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861761+0000", 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2740000000000002e-06 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938385+0000", 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076624135999999995 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938464+0000", 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9232000000000003e-05 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938656+0000", 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019190400000000001 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20820 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 929792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819147045999999, 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077243888999999996, 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20820 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861764+0000", 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861777+0000", 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3089e-05 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861784+0000", 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861789+0000", 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938674+0000", 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076885242000000006 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938740+0000", 2024-09-14T07:12:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5790999999999994e-05 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939007+0000", 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026745499999999999 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20821 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 987136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819112985, 2024-09-14T07:12:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077536638000000005, 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20821 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861798+0000", 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861800+0000", 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.956e-06 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861807+0000", 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250000000000002e-06 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861812+0000", 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5469999999999998e-06 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939032+0000", 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077220252000000003 2024-09-14T07:12:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939146+0000", 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011423 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939334+0000", 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018782799999999999 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20823 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1044480~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.819092025, 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077848745999999996, 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20823 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861819+0000", 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.77e-07 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861820+0000", 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.792e-06 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861827+0000", 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8979999999999999e-06 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861832+0000", 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3630000000000004e-06 2024-09-14T07:12:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939383+0000", 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077551163000000006 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939475+0000", 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2471000000000003e-05 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939667+0000", 2024-09-14T07:12:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019168200000000001 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8243635919999992, 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:12:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8243279799999996, 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:12:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:12:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8212873779999992, 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:12:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:12:30.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:12:30.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:30.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:30.779 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:30.780 INFO:teuthology.orchestra.run.smithi071.stdout:2987 writesame 0x4f7abf2 thru 0x4f8505b data_size 0x6(0xa46a bytes) 2024-09-14T07:12:30.780 INFO:teuthology.orchestra.run.smithi071.stdout:2989 write 0x5737290 thru 0x573c0a3 (0x4e14 bytes) 2024-09-14T07:12:30.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:30.782 INFO:teuthology.orchestra.run.smithi071.stdout:2991 write 0x18f9eaa thru 0x1901bbc (0x7d13 bytes) 2024-09-14T07:12:30.782 INFO:teuthology.orchestra.run.smithi071.stdout:2992 trunc from 0x573c0a4 to 0x6389633 2024-09-14T07:12:30.782 INFO:teuthology.orchestra.run.smithi071.stdout:2993 writesame 0x9061760 thru 0x906e3ff data_size 0x10(0xcca0 bytes) 2024-09-14T07:12:30.782 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.782 INFO:teuthology.orchestra.run.smithi071.stdout:2995 trunc from 0x906e400 to 0x4f9dbb3 2024-09-14T07:12:30.782 INFO:teuthology.orchestra.run.smithi071.stdout:2996 trunc from 0x4f9dbb3 to 0x90c2bb4 2024-09-14T07:12:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:3000 read 0x49ea59f thru 0x49f949c (0xeefe bytes) 2024-09-14T07:12:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:3001 trunc from 0x90c2bb4 to 0xda2d08c 2024-09-14T07:12:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:3003 writesame 0x3836182 thru 0x3841229 data_size 0x4(0xb0a8 bytes) 2024-09-14T07:12:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:3004 write 0x4c11372 thru 0x4c172d2 (0x5f61 bytes) 2024-09-14T07:12:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:3006 trunc from 0xda2d08c to 0x41489bd 2024-09-14T07:12:30.783 INFO:teuthology.orchestra.run.smithi071.stdout:3009 write 0xbe482e2 thru 0xbe52fb6 (0xacd5 bytes) 2024-09-14T07:12:30.783 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:30.779+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:30.784 INFO:teuthology.orchestra.run.smithi071.stdout:3011 write 0x288755 thru 0x29371e (0xafca bytes) 2024-09-14T07:12:30.792 INFO:teuthology.orchestra.run.smithi071.stdout:3012 write 0xc9320ff thru 0xc93a27f (0x8181 bytes) 2024-09-14T07:12:30.794 INFO:teuthology.orchestra.run.smithi071.stdout:3013 write 0x54be08b thru 0x54cb140 (0xd0b6 bytes) 2024-09-14T07:12:30.797 INFO:teuthology.orchestra.run.smithi071.stdout:3014 write 0x6cb3fff thru 0x6cbd0b0 (0x90b2 bytes) 2024-09-14T07:12:30.800 INFO:teuthology.orchestra.run.smithi071.stdout:3015 write 0x4db60d1 thru 0x4dbc8ec (0x681c bytes) 2024-09-14T07:12:30.802 INFO:teuthology.orchestra.run.smithi071.stdout:3016 write 0xaa4ff57 thru 0xaa58660 (0x870a bytes) 2024-09-14T07:12:30.806 INFO:teuthology.orchestra.run.smithi071.stdout:3018 read 0xb43780b thru 0xb43efb2 (0x77a8 bytes) 2024-09-14T07:12:30.806 INFO:teuthology.orchestra.run.smithi071.stdout:3019 write 0x4db4693 thru 0x4dc3b9b (0xf509 bytes) 2024-09-14T07:12:30.808 INFO:teuthology.orchestra.run.smithi071.stdout:3020 punch from 0xa412f0a to 0xa41508a, (0x2180 bytes) 2024-09-14T07:12:30.808 INFO:teuthology.orchestra.run.smithi071.stdout:3021 read 0x9e77934 thru 0x9e87169 (0xf836 bytes) 2024-09-14T07:12:30.808 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.809 INFO:teuthology.orchestra.run.smithi071.stdout:3023 read 0x6c88cd8 thru 0x6c89643 (0x96c bytes) 2024-09-14T07:12:30.809 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.809 INFO:teuthology.orchestra.run.smithi071.stdout:3028 read 0x1d4615d thru 0x1d4ddbd (0x7c61 bytes) 2024-09-14T07:12:30.809 INFO:teuthology.orchestra.run.smithi071.stdout:3029 read 0x3b1c58c thru 0x3b292da (0xcd4f bytes) 2024-09-14T07:12:30.809 INFO:teuthology.orchestra.run.smithi071.stdout:3030 write 0x46c7d31 thru 0x46cb5c9 (0x3899 bytes) 2024-09-14T07:12:30.811 INFO:teuthology.orchestra.run.smithi071.stdout:3032 write 0x2ddf727 thru 0x2de656b (0x6e45 bytes) 2024-09-14T07:12:30.816 INFO:teuthology.orchestra.run.smithi071.stdout:3033 trunc from 0xc93a280 to 0xae3f179 2024-09-14T07:12:30.825 INFO:teuthology.orchestra.run.smithi071.stdout:3035 read 0x55d5356 thru 0x55e0c83 (0xb92e bytes) 2024-09-14T07:12:30.825 INFO:teuthology.orchestra.run.smithi071.stdout:3036 writesame 0xad2804b thru 0xad37144 data_size 0x3e(0xf0fa bytes) 2024-09-14T07:12:30.828 INFO:teuthology.orchestra.run.smithi071.stdout:3037 write 0x40874b3 thru 0x408e418 (0x6f66 bytes) 2024-09-14T07:12:30.836 INFO:teuthology.orchestra.run.smithi071.stdout:3039 write 0xc669838 thru 0xc673e38 (0xa601 bytes) 2024-09-14T07:12:30.840 INFO:teuthology.orchestra.run.smithi071.stdout:3040 punch from 0x12edbd8 to 0x12f9b7a, (0xbfa2 bytes) 2024-09-14T07:12:30.840 INFO:teuthology.orchestra.run.smithi071.stdout:3041 write 0x364e744 thru 0x3653f83 (0x5840 bytes) 2024-09-14T07:12:30.850 INFO:teuthology.orchestra.run.smithi071.stdout:3042 trunc from 0xc673e39 to 0x5c8703c 2024-09-14T07:12:30.859 INFO:teuthology.orchestra.run.smithi071.stdout:3044 writesame 0x10299fc thru 0x102fdc9 data_size 0x49(0x63ce bytes) 2024-09-14T07:12:30.860 INFO:teuthology.orchestra.run.smithi071.stdout:3045 read 0x2f4352b thru 0x2f4e430 (0xaf06 bytes) 2024-09-14T07:12:30.860 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.866 INFO:teuthology.orchestra.run.smithi071.stdout:3047 write 0x60552c2 thru 0x605e42f (0x916e bytes) 2024-09-14T07:12:30.870 INFO:teuthology.orchestra.run.smithi071.stdout:3048 punch from 0x1bd4d9b to 0x1bd6593, (0x17f8 bytes) 2024-09-14T07:12:30.870 INFO:teuthology.orchestra.run.smithi071.stdout:3050 write 0x7cea8e thru 0x7d4260 (0x57d3 bytes) 2024-09-14T07:12:30.876 INFO:teuthology.orchestra.run.smithi071.stdout:3051 punch from 0x8723a3 to 0x875527, (0x3184 bytes) 2024-09-14T07:12:30.876 INFO:teuthology.orchestra.run.smithi071.stdout:3052 read 0x320af0d thru 0x3213a51 (0x8b45 bytes) 2024-09-14T07:12:30.876 INFO:teuthology.orchestra.run.smithi071.stdout:3053 write 0x24e103d thru 0x24e324e (0x2212 bytes) 2024-09-14T07:12:30.878 INFO:teuthology.orchestra.run.smithi071.stdout:3055 punch from 0x582c794 to 0x583b6f8, (0xef64 bytes) 2024-09-14T07:12:30.879 INFO:teuthology.orchestra.run.smithi071.stdout:3056 read 0x15ea726 thru 0x15fa213 (0xfaee bytes) 2024-09-14T07:12:30.879 INFO:teuthology.orchestra.run.smithi071.stdout:3057 read 0x151fbc0 thru 0x1521c32 (0x2073 bytes) 2024-09-14T07:12:30.881 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:30.880+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:30.895 INFO:teuthology.orchestra.run.smithi071.stdout:3059 writesame 0xd588662 thru 0xd594c8a data_size 0x1(0xc629 bytes) 2024-09-14T07:12:30.895 INFO:teuthology.orchestra.run.smithi071.stdout:3060 punch from 0x17b2d50 to 0x17be6e9, (0xb999 bytes) 2024-09-14T07:12:30.895 INFO:teuthology.orchestra.run.smithi071.stdout:3061 read 0xb9678d4 thru 0xb9729a2 (0xb0cf bytes) 2024-09-14T07:12:30.895 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.895 INFO:teuthology.orchestra.run.smithi071.stdout:3063 read 0x67f4a1a thru 0x67fd5ad (0x8b94 bytes) 2024-09-14T07:12:30.895 INFO:teuthology.orchestra.run.smithi071.stdout:3064 write 0x1e6991b thru 0x1e6f673 (0x5d59 bytes) 2024-09-14T07:12:30.897 INFO:teuthology.orchestra.run.smithi071.stdout:3066 writesame 0x43b1a2d thru 0x43bafb9 data_size 0x41(0x958d bytes) 2024-09-14T07:12:30.900 INFO:teuthology.orchestra.run.smithi071.stdout:3067 read 0xd246f4f thru 0xd24cee1 (0x5f93 bytes) 2024-09-14T07:12:30.900 INFO:teuthology.orchestra.run.smithi071.stdout:3069 read 0x4cd6f thru 0x59243 (0xc4d5 bytes) 2024-09-14T07:12:30.900 INFO:teuthology.orchestra.run.smithi071.stdout:3070 write 0xcf7cfdb thru 0xcf87e04 (0xae2a bytes) 2024-09-14T07:12:30.903 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:30.903 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:30.903 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:30.903 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:30.907 INFO:teuthology.orchestra.run.smithi071.stdout:3072 read 0xa648eac thru 0xa652493 (0x95e8 bytes) 2024-09-14T07:12:30.907 INFO:teuthology.orchestra.run.smithi071.stdout:3074 writesame 0x8554bfa thru 0x8558b2b data_size 0x1(0x3f32 bytes) 2024-09-14T07:12:30.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:30.914 INFO:teuthology.orchestra.run.smithi071.stdout:3075 read 0x54841d1 thru 0x548b68d (0x74bd bytes) 2024-09-14T07:12:30.914 INFO:teuthology.orchestra.run.smithi071.stdout:3076 writesame 0xce920ce thru 0xce952a0 data_size 0x1(0x31d3 bytes) 2024-09-14T07:12:30.919 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.920 INFO:teuthology.orchestra.run.smithi071.stdout:3078 write 0xa24ad35 thru 0xa259298 (0xe564 bytes) 2024-09-14T07:12:30.928 INFO:teuthology.orchestra.run.smithi071.stdout:3079 trunc from 0xd594c8b to 0xbe444a4 2024-09-14T07:12:30.936 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.939 INFO:teuthology.orchestra.run.smithi071.stdout:3081 trunc from 0xbe444a4 to 0x9f33a88 2024-09-14T07:12:30.947 INFO:teuthology.orchestra.run.smithi071.stdout:3082 read 0x8c7852d thru 0x8c88171 (0xfc45 bytes) 2024-09-14T07:12:30.947 INFO:teuthology.orchestra.run.smithi071.stdout:3083 read 0x5d3d79d thru 0x5d47b86 (0xa3ea bytes) 2024-09-14T07:12:30.947 INFO:teuthology.orchestra.run.smithi071.stdout:3084 punch from 0x6f64daa to 0x6f68bf5, (0x3e4b bytes) 2024-09-14T07:12:30.947 INFO:teuthology.orchestra.run.smithi071.stdout:3085 read 0x54002d5 thru 0x540196b (0x1697 bytes) 2024-09-14T07:12:30.957 INFO:teuthology.orchestra.run.smithi071.stdout:3087 write 0xd84f6a7 thru 0xd84f75b (0xb5 bytes) 2024-09-14T07:12:30.960 INFO:teuthology.orchestra.run.smithi071.stdout:3089 read 0x75a9e1b thru 0x75b282b (0x8a11 bytes) 2024-09-14T07:12:30.960 INFO:teuthology.orchestra.run.smithi071.stdout:3090 write 0xc7003c7 thru 0xc7088ef (0x8529 bytes) 2024-09-14T07:12:30.963 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:30.976 INFO:teuthology.orchestra.run.smithi071.stdout:3092 trunc from 0xd84f75c to 0x2904cb6 2024-09-14T07:12:30.982 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:30.981+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:31.000 INFO:teuthology.orchestra.run.smithi071.stdout:3095 trunc from 0x2904cb6 to 0xcca1590 2024-09-14T07:12:31.005 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.005 INFO:teuthology.orchestra.run.smithi071.stdout:3099 write 0x5c83e17 thru 0x5c8bc78 (0x7e62 bytes) 2024-09-14T07:12:31.008 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.008 INFO:teuthology.orchestra.run.smithi071.stdout:3101 write 0x7bd5160 thru 0x7bdf4de (0xa37f bytes) 2024-09-14T07:12:31.017 INFO:teuthology.orchestra.run.smithi071.stdout:3102 write 0xed5e732 thru 0xed65da6 (0x7675 bytes) 2024-09-14T07:12:31.020 INFO:teuthology.orchestra.run.smithi071.stdout:3103 read 0x24199f2 thru 0x24268cc (0xcedb bytes) 2024-09-14T07:12:31.020 INFO:teuthology.orchestra.run.smithi071.stdout:3106 writesame 0x1598e27 thru 0x15a3142 data_size 0x4(0xa31c bytes) 2024-09-14T07:12:31.024 INFO:teuthology.orchestra.run.smithi071.stdout:3108 write 0x2d7f901 thru 0x2d84d9a (0x549a bytes) 2024-09-14T07:12:31.027 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.028 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.032 INFO:teuthology.orchestra.run.smithi071.stdout:3112 trunc from 0xed65da7 to 0xae31560 2024-09-14T07:12:31.033 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:31.033 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:31.033 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:31.033 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:31.033 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:31.040 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:31.046 INFO:teuthology.orchestra.run.smithi071.stdout:3114 write 0xc3388a4 thru 0xc34555a (0xccb7 bytes) 2024-09-14T07:12:31.050 INFO:teuthology.orchestra.run.smithi071.stdout:3115 write 0x5eb647a thru 0x5eba997 (0x451e bytes) 2024-09-14T07:12:31.052 INFO:teuthology.orchestra.run.smithi071.stdout:3116 punch from 0x7c36d79 to 0x7c41e5b, (0xb0e2 bytes) 2024-09-14T07:12:31.052 INFO:teuthology.orchestra.run.smithi071.stdout:3117 read 0x462e4ce thru 0x4639522 (0xb055 bytes) 2024-09-14T07:12:31.063 INFO:teuthology.orchestra.run.smithi071.stdout:3118 trunc from 0xc34555b to 0x37230a5 2024-09-14T07:12:31.081 INFO:teuthology.orchestra.run.smithi071.stdout:3119 trunc from 0x37230a5 to 0xacdc097 2024-09-14T07:12:31.082 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:31.082+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:31.087 INFO:teuthology.orchestra.run.smithi071.stdout:3121 punch from 0x8080dbb to 0x80856f4, (0x4939 bytes) 2024-09-14T07:12:31.087 INFO:teuthology.orchestra.run.smithi071.stdout:3123 read 0x2731529 thru 0x2740fed (0xfac5 bytes) 2024-09-14T07:12:31.087 INFO:teuthology.orchestra.run.smithi071.stdout:3125 read 0x6a3c0c8 thru 0x6a4900a (0xcf43 bytes) 2024-09-14T07:12:31.097 INFO:teuthology.orchestra.run.smithi071.stdout:3126 trunc from 0xacdc097 to 0x2245fc9 2024-09-14T07:12:31.106 INFO:teuthology.orchestra.run.smithi071.stdout:3127 read 0xa095f thru 0xaa551 (0x9bf3 bytes) 2024-09-14T07:12:31.120 INFO:teuthology.orchestra.run.smithi071.stdout:3129 trunc from 0x2245fc9 to 0xd4c31c1 2024-09-14T07:12:31.126 INFO:teuthology.orchestra.run.smithi071.stdout:3130 trunc from 0xd4c31c1 to 0xcf77db2 2024-09-14T07:12:31.130 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.135 INFO:teuthology.orchestra.run.smithi071.stdout:3133 trunc from 0xcf77db2 to 0x9654f8e 2024-09-14T07:12:31.149 INFO:teuthology.orchestra.run.smithi071.stdout:3136 write 0xcbd69dc thru 0xcbdb0e2 (0x4707 bytes) 2024-09-14T07:12:31.151 INFO:teuthology.orchestra.run.smithi071.stdout:3137 read 0x3f2edb4 thru 0x3f38d4b (0x9f98 bytes) 2024-09-14T07:12:31.152 INFO:teuthology.orchestra.run.smithi071.stdout:3139 write 0xa1388eb thru 0xa144776 (0xbe8c bytes) 2024-09-14T07:12:31.164 INFO:teuthology.orchestra.run.smithi071.stdout:3140 trunc from 0xcbdb0e3 to 0x6051444 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1300100000000004, 2024-09-14T07:12:31.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:12:31.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.169 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:31.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:12:31.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:12:31.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299845279999996, 2024-09-14T07:12:31.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:12:31.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:12:31.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:12:31.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299728550000001, 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.183 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:31.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299620800000003, 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:31.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:31.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:12:31.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:31.193 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299515390000003, 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:12:31.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.198 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299410709999993, 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:12:31.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299305589999999, 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299202210000008, 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.208 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:12:31.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.212 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1299098779999994, 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.213 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:12:31.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1298912899999998, 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:31.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1298802000000006, 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.223 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:12:31.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:12:31.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.227 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1298694979999997, 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:12:31.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:12:31.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1298487490000007, 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:12:31.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1298228879999996, 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:12:31.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:12:31.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1298030519999998, 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:31.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:31.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:12:31.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:31.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:12:31.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:12:31.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:12:31.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:12:31.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:12:31.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:12:31.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:12:31.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:12:31.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:12:31.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:12:31.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:12:31.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:12:31.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1297774290000007, 2024-09-14T07:12:31.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:12:31.256 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:12:31.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.257 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:31.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:12:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:12:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:12:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:12:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:12:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:12:31.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:12:31.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:12:31.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1297386199999995, 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:12:31.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1297179509999999, 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:31.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.274 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1243570209999998, 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:31.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:12:31.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.124342467, 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:31.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:31.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:12:31.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:31.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:31.283 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:31.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:31.287 INFO:teuthology.orchestra.run.smithi071.stdout:3142 read 0x103607e thru 0x103e831 (0x87b4 bytes) 2024-09-14T07:12:31.287 INFO:teuthology.orchestra.run.smithi071.stdout:3143 punch from 0x36d97fe to 0x36dca5e, (0x3260 bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3144 writesame 0x474605c thru 0x475367d data_size 0x1(0xd622 bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3145 read 0x5ee1dea thru 0x5eeb0d6 (0x92ed bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3146 read 0x240979 thru 0x243a29 (0x30b1 bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3149 write 0x851669a thru 0x8519e0e (0x3775 bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3150 trunc from 0x8519e0f to 0x201270a 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3151 write 0x5253b49 thru 0x5255fa1 (0x2459 bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3152 read 0x2620b97 thru 0x2623163 (0x25cd bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3153 write 0x9277ba3 thru 0x9284972 (0xcdd0 bytes) 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3156 trunc from 0x9284973 to 0x84c2a9a 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.288 INFO:teuthology.orchestra.run.smithi071.stdout:3159 punch from 0x75ffd4c to 0x760cfdc, (0xd290 bytes) 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:3160 write 0xc06e636 thru 0xc078cf9 (0xa6c4 bytes) 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:3163 punch from 0x42a1636 to 0x42a1dc2, (0x78c bytes) 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:3165 write 0x6726478 thru 0x6729df1 (0x397a bytes) 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:3166 write 0x4ea2440 thru 0x4ea3289 (0xe4a bytes) 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:3167 punch from 0x9efbd0b to 0x9efd942, (0x1c37 bytes) 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.289 INFO:teuthology.orchestra.run.smithi071.stdout:3170 trunc from 0xc078cfa to 0x8451822 2024-09-14T07:12:31.289 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:31.284+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:31.293 INFO:teuthology.orchestra.run.smithi071.stdout:3172 writesame 0x15206a7 thru 0x1526324 data_size 0x1(0x5c7e bytes) 2024-09-14T07:12:31.309 INFO:teuthology.orchestra.run.smithi071.stdout:3174 trunc from 0x8451822 to 0xdde48d8 2024-09-14T07:12:31.322 INFO:teuthology.orchestra.run.smithi071.stdout:3176 trunc from 0xdde48d8 to 0x7dfbe65 2024-09-14T07:12:31.326 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.326 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.326 INFO:teuthology.orchestra.run.smithi071.stdout:3181 write 0x725767e thru 0x725a4a6 (0x2e29 bytes) 2024-09-14T07:12:31.329 INFO:teuthology.orchestra.run.smithi071.stdout:3182 punch from 0x223ef7f to 0x224a0a7, (0xb128 bytes) 2024-09-14T07:12:31.330 INFO:teuthology.orchestra.run.smithi071.stdout:3185 read 0xb29d1e thru 0xb39c61 (0xff44 bytes) 2024-09-14T07:12:31.330 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.330 INFO:teuthology.orchestra.run.smithi071.stdout:3187 write 0x51ab99b thru 0x51b6ab6 (0xb11c bytes) 2024-09-14T07:12:31.345 INFO:teuthology.orchestra.run.smithi071.stdout:3188 write 0xcf71fd5 thru 0xcf80ce3 (0xed0f bytes) 2024-09-14T07:12:31.348 INFO:teuthology.orchestra.run.smithi071.stdout:3191 trunc from 0xcf80ce4 to 0xd33ae9d 2024-09-14T07:12:31.356 INFO:teuthology.orchestra.run.smithi071.stdout:3192 trunc from 0xd33ae9d to 0xa93e56f 2024-09-14T07:12:31.365 INFO:teuthology.orchestra.run.smithi071.stdout:3193 write 0x2e9ce72 thru 0x2ea18a8 (0x4a37 bytes) 2024-09-14T07:12:31.381 INFO:teuthology.orchestra.run.smithi071.stdout:3194 trunc from 0xa93e56f to 0x208847a 2024-09-14T07:12:31.385 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:31.384+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:31.409 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:31.409 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:31.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:31.409 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:31.411 INFO:teuthology.orchestra.run.smithi071.stdout:3195 writesame 0xcf8758e thru 0xcf8ec05 data_size 0x44(0x7678 bytes) 2024-09-14T07:12:31.411 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.411 INFO:teuthology.orchestra.run.smithi071.stdout:3199 write 0x4aa3c2a thru 0x4aa6bc9 (0x2fa0 bytes) 2024-09-14T07:12:31.415 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:31.415 INFO:teuthology.orchestra.run.smithi071.stdout:3202 writesame 0x1a30243 thru 0x1a32348 data_size 0x3(0x2106 bytes) 2024-09-14T07:12:31.417 INFO:teuthology.orchestra.run.smithi071.stdout:3203 writesame 0x58950f3 thru 0x589da4e data_size 0x4(0x895c bytes) 2024-09-14T07:12:31.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:31.423 INFO:teuthology.orchestra.run.smithi071.stdout:3204 clone 23 order 22 su 2097152 sc 13 2024-09-14T07:12:31.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:31.512 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:31.511+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:31.527 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:31.527 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:31.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:31.587 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:31.586+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:31.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:31.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:31.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:31.639 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:31.655 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:31.655 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:31.688 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:31.688 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:31.687+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:31.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:31.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:31.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:31.725 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:31.725 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:31.789 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:31.788+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:31.825 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:31.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:31.854 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:12:31.889 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:31.888+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:31.907 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone22 from 0xcf8ec06 (overlap 0x18904f4) to 0x13a6a5c 2024-09-14T07:12:31.990 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-14T07:12:31.991 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:31.990+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:31.993 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:32.093 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:32.092+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:32.160 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.160 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:32.211 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:32.210+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:32.259 INFO:teuthology.orchestra.run.smithi071.stdout:3205 write 0x5d59b13 thru 0x5d6469b (0xab89 bytes) 2024-09-14T07:12:32.273 INFO:teuthology.orchestra.run.smithi071.stdout:3207 write 0xe812e47 thru 0xe815a6b (0x2c25 bytes) 2024-09-14T07:12:32.276 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.276 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.276 INFO:teuthology.orchestra.run.smithi071.stdout:3208 writesame 0x3267135 thru 0x3272157 data_size 0x1(0xb023 bytes) 2024-09-14T07:12:32.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:32.292 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:32.292+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:32.301 INFO:teuthology.orchestra.run.smithi071.stdout:3209 read 0x31403ae thru 0x3142240 (0x1e93 bytes) 2024-09-14T07:12:32.301 INFO:teuthology.orchestra.run.smithi071.stdout:3210 writesame 0x829c13 thru 0x82e3dc data_size 0x9(0x47ca bytes) 2024-09-14T07:12:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:3211 read 0xd387792 thru 0xd387e08 (0x677 bytes) 2024-09-14T07:12:32.307 INFO:teuthology.orchestra.run.smithi071.stdout:3213 write 0xc30bb0c thru 0xc3170fe (0xb5f3 bytes) 2024-09-14T07:12:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:3214 read 0x9ef67d7 thru 0x9f018b4 (0xb0de bytes) 2024-09-14T07:12:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:32.310 INFO:teuthology.orchestra.run.smithi071.stdout:3216 punch from 0x4f34e4c to 0x4f37dfc, (0x2fb0 bytes) 2024-09-14T07:12:32.314 INFO:teuthology.orchestra.run.smithi071.stdout:3217 trunc from 0xe815a6c to 0xae2cd7e 2024-09-14T07:12:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:3220 write 0x4c3108 thru 0x4c61be (0x30b7 bytes) 2024-09-14T07:12:32.344 INFO:teuthology.orchestra.run.smithi071.stdout:3222 write 0x149ea5a thru 0x14a2179 (0x3720 bytes) 2024-09-14T07:12:32.349 INFO:teuthology.orchestra.run.smithi071.stdout:3225 write 0x6b9630d thru 0x6b9ed2f (0x8a23 bytes) 2024-09-14T07:12:32.362 INFO:teuthology.orchestra.run.smithi071.stdout:3226 writesame 0xda2dc53 thru 0xda36184 data_size 0x2(0x8532 bytes) 2024-09-14T07:12:32.362 INFO:teuthology.orchestra.run.smithi071.stdout:3227 punch from 0x120b598 to 0x1218f36, (0xd99e bytes) 2024-09-14T07:12:32.362 INFO:teuthology.orchestra.run.smithi071.stdout:3228 clone 24 order 23 su 4194304 sc 6 2024-09-14T07:12:32.394 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:32.393+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:32.397 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.397 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:32.495 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:32.493+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:32.509 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.509 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.518 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:32.602 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:32.601+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:32.661 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.661 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:32.697 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:32.696+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:32.797 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:32.797+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:32.811 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.811 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:32.843 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:32.843 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:32.843 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T07:12:32.843 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.900501 2024-09-14T07:12:32.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.900500719377429 2024-09-14T07:12:32.870 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:12:32.926 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:32.925+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:32.934 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone23 from 0xda36185 (overlap 0xae2cd7e) to 0x0 2024-09-14T07:12:32.980 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:32.980 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:32.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:33.033 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:33.032+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:33.038 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-14T07:12:33.074 INFO:teuthology.orchestra.run.smithi071.stdout:3229 trunc from 0xda36185 to 0x7efc045 2024-09-14T07:12:33.099 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:33.099 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:33.099 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:33.098+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:33.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:33.111 INFO:teuthology.orchestra.run.smithi071.stdout:3230 write 0xbed7eae thru 0xbee47a5 (0xc8f8 bytes) 2024-09-14T07:12:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:3231 punch from 0x90677d9 to 0x9076d50, (0xf577 bytes) 2024-09-14T07:12:33.114 INFO:teuthology.orchestra.run.smithi071.stdout:3232 write 0x1fd033e thru 0x1fe005f (0xfd22 bytes) 2024-09-14T07:12:33.128 INFO:teuthology.orchestra.run.smithi071.stdout:3233 write 0x96a621c thru 0x96ad7fb (0x75e0 bytes) 2024-09-14T07:12:33.130 INFO:teuthology.orchestra.run.smithi071.stdout:3235 punch from 0x1cf8227 to 0x1d06fdc, (0xedb5 bytes) 2024-09-14T07:12:33.144 INFO:teuthology.orchestra.run.smithi071.stdout:3236 trunc from 0xbee47a6 to 0x3a033e 2024-09-14T07:12:33.195 INFO:teuthology.orchestra.run.smithi071.stdout:3237 write 0xd242368 thru 0xd24c531 (0xa1ca bytes) 2024-09-14T07:12:33.197 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.197 INFO:teuthology.orchestra.run.smithi071.stdout:3239 punch from 0x254511c to 0x254c8f6, (0x77da bytes) 2024-09-14T07:12:33.198 INFO:teuthology.orchestra.run.smithi071.stdout:3241 read 0xc3fd00f thru 0xc40c780 (0xf772 bytes) 2024-09-14T07:12:33.198 INFO:teuthology.orchestra.run.smithi071.stdout:3242 read 0x2f640d9 thru 0x2f70e7c (0xcda4 bytes) 2024-09-14T07:12:33.198 INFO:teuthology.orchestra.run.smithi071.stdout:3243 write 0x7e8e641 thru 0x7e9d7f0 (0xf1b0 bytes) 2024-09-14T07:12:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:3244 write 0x66e7562 thru 0x66ebff9 (0x4a98 bytes) 2024-09-14T07:12:33.200 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:33.199+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:3245 read 0x4f626a4 thru 0x4f715f9 (0xef56 bytes) 2024-09-14T07:12:33.201 INFO:teuthology.orchestra.run.smithi071.stdout:3246 writesame 0x73a62a9 thru 0x73a7e96 data_size 0xa(0x1bee bytes) 2024-09-14T07:12:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:3251 read 0x5140bc8 thru 0x514f715 (0xeb4e bytes) 2024-09-14T07:12:33.203 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.204 INFO:teuthology.orchestra.run.smithi071.stdout:3253 write 0x386dcb1 thru 0x387d972 (0xfcc2 bytes) 2024-09-14T07:12:33.206 INFO:teuthology.orchestra.run.smithi071.stdout:3254 write 0x6b14c7 thru 0x6b5d9a (0x48d4 bytes) 2024-09-14T07:12:33.217 INFO:teuthology.orchestra.run.smithi071.stdout:3256 trunc from 0xd24c532 to 0x5bfad92 2024-09-14T07:12:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:3257 read 0x4f9b3b7 thru 0x4f9d178 (0x1dc2 bytes) 2024-09-14T07:12:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:3259 read 0x177bea5 thru 0x177cc8d (0xde9 bytes) 2024-09-14T07:12:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:3260 punch from 0x289b6b1 to 0x28a316c, (0x7abb bytes) 2024-09-14T07:12:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:3263 punch from 0x2d01a56 to 0x2d0890c, (0x6eb6 bytes) 2024-09-14T07:12:33.231 INFO:teuthology.orchestra.run.smithi071.stdout:3264 writesame 0x796b380 thru 0x7971760 data_size 0x3(0x63e1 bytes) 2024-09-14T07:12:33.239 INFO:teuthology.orchestra.run.smithi071.stdout:3265 trunc from 0x7971761 to 0xd98d810 2024-09-14T07:12:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:3266 read 0x198ee95 thru 0x1997522 (0x868e bytes) 2024-09-14T07:12:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:3268 write 0x5a0c3f5 thru 0x5a12cb8 (0x68c4 bytes) 2024-09-14T07:12:33.246 INFO:teuthology.orchestra.run.smithi071.stdout:3269 write 0x98e8ac thru 0x99c3ef (0xdb44 bytes) 2024-09-14T07:12:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:3270 punch from 0x300568d to 0x300ec76, (0x95e9 bytes) 2024-09-14T07:12:33.248 INFO:teuthology.orchestra.run.smithi071.stdout:3271 trunc from 0xd98d810 to 0xd6d46f2 2024-09-14T07:12:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:3272 read 0x88f3639 thru 0x88f8695 (0x505d bytes) 2024-09-14T07:12:33.253 INFO:teuthology.orchestra.run.smithi071.stdout:3273 read 0x33d33d5 thru 0x33d84dc (0x5108 bytes) 2024-09-14T07:12:33.254 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:33.254 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:3274 writesame 0xdfaf10e thru 0xdfb65a1 data_size 0x12(0x7494 bytes) 2024-09-14T07:12:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:3275 punch from 0x908dee1 to 0x9099f13, (0xc032 bytes) 2024-09-14T07:12:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.258 INFO:teuthology.orchestra.run.smithi071.stdout:3277 write 0xaea3508 thru 0xaeb1274 (0xdd6d bytes) 2024-09-14T07:12:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:3280 punch from 0x9b7b5c to 0x9bc784, (0x4c28 bytes) 2024-09-14T07:12:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:3281 punch from 0x63a4937 to 0x63a69cf, (0x2098 bytes) 2024-09-14T07:12:33.261 INFO:teuthology.orchestra.run.smithi071.stdout:3283 write 0x887a932 thru 0x887d009 (0x26d8 bytes) 2024-09-14T07:12:33.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:33.263 INFO:teuthology.orchestra.run.smithi071.stdout:3284 write 0x2c120b8 thru 0x2c19bee (0x7b37 bytes) 2024-09-14T07:12:33.265 INFO:teuthology.orchestra.run.smithi071.stdout:3285 write 0xac36e0d thru 0xac43640 (0xc834 bytes) 2024-09-14T07:12:33.266 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.267 INFO:teuthology.orchestra.run.smithi071.stdout:3288 write 0xafb0959 thru 0xafbc956 (0xbffe bytes) 2024-09-14T07:12:33.272 INFO:teuthology.orchestra.run.smithi071.stdout:3290 trunc from 0xdfb65a2 to 0xa95da3e 2024-09-14T07:12:33.279 INFO:teuthology.orchestra.run.smithi071.stdout:3291 trunc from 0xa95da3e to 0xabfcef4 2024-09-14T07:12:33.283 INFO:teuthology.orchestra.run.smithi071.stdout:3292 writesame 0x8497599 thru 0x849a797 data_size 0x1(0x31ff bytes) 2024-09-14T07:12:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:3294 read 0x6794ae4 thru 0x67983af (0x38cc bytes) 2024-09-14T07:12:33.289 INFO:teuthology.orchestra.run.smithi071.stdout:3296 read 0x3080e4e thru 0x3089cc9 (0x8e7c bytes) 2024-09-14T07:12:33.299 INFO:teuthology.orchestra.run.smithi071.stdout:3297 writesame 0xe22cc3d thru 0xe232971 data_size 0x1(0x5d35 bytes) 2024-09-14T07:12:33.299 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.307 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:33.306+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:33.311 INFO:teuthology.orchestra.run.smithi071.stdout:3299 trunc from 0xe232972 to 0x3eacacc 2024-09-14T07:12:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:3300 read 0x12731b9 thru 0x12738e7 (0x72f bytes) 2024-09-14T07:12:33.324 INFO:teuthology.orchestra.run.smithi071.stdout:3301 write 0x32a9702 thru 0x32ad11c (0x3a1b bytes) 2024-09-14T07:12:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:3302 read 0x2ab055a thru 0x2ab1b83 (0x162a bytes) 2024-09-14T07:12:33.335 INFO:teuthology.orchestra.run.smithi071.stdout:3303 trunc from 0x3eacacc to 0x9eef2df 2024-09-14T07:12:33.341 INFO:teuthology.orchestra.run.smithi071.stdout:3304 trunc from 0x9eef2df to 0x918bb12 2024-09-14T07:12:33.346 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:33.346 INFO:teuthology.orchestra.run.smithi071.stdout:3306 clone 25 order 19 su 2048 sc 7 2024-09-14T07:12:33.368 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:33.368 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:33.377 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:33.418 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:33.417+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:33.479 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:33.488 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:33.534 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:33.533+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:33.590 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:33.591 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:33.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:33.640 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:33.639+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:33.704 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:33.704+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:33.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:33.742 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:33.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:33.805 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:33.804+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:33.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:33.849 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:33.860 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.1 primary-affinity to 0.900501 (8590152) 2024-09-14T07:12:33.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:33.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:33.889 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:33.889 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:33.903 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:33.904 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:33.906 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:33.905+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:33.908 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:33.908 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:33.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:33.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:33.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:33.929 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:33.941 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone24 from 0x918bb12 (overlap 0x3a033e) to 0x0 2024-09-14T07:12:33.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:33.948 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:33.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:33.971 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:33.972 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:34.008 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-14T07:12:34.009 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:34.008+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:34.009 INFO:teuthology.orchestra.run.smithi071.stdout:3308 read 0x3ea29f4 thru 0x3eabcbb (0x92c8 bytes) 2024-09-14T07:12:34.010 INFO:teuthology.orchestra.run.smithi071.stdout:3310 write 0x4445c8d thru 0x444738f (0x1703 bytes) 2024-09-14T07:12:34.019 INFO:teuthology.orchestra.run.smithi071.stdout:3311 read 0x30798d2 thru 0x3088e33 (0xf562 bytes) 2024-09-14T07:12:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:3312 punch from 0x2c054e7 to 0x2c073fe, (0x1f17 bytes) 2024-09-14T07:12:34.024 INFO:teuthology.orchestra.run.smithi071.stdout:3314 punch from 0x855d1e6 to 0x8563026, (0x5e40 bytes) 2024-09-14T07:12:34.036 INFO:teuthology.orchestra.run.smithi071.stdout:3315 write 0xe0d73c7 thru 0xe0e2c77 (0xb8b1 bytes) 2024-09-14T07:12:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:34.047 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:3317 punch from 0x4c3ec04 to 0x4c48d23, (0xa11f bytes) 2024-09-14T07:12:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:3318 read 0x44dc49f thru 0x44df2b3 (0x2e15 bytes) 2024-09-14T07:12:34.048 INFO:teuthology.orchestra.run.smithi071.stdout:3320 write 0xa2c0e30 thru 0xa2cf415 (0xe5e6 bytes) 2024-09-14T07:12:34.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:34.058 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.064 INFO:teuthology.orchestra.run.smithi071.stdout:3324 write 0xe55ce8a thru 0xe566f55 (0xa0cc bytes) 2024-09-14T07:12:34.074 INFO:teuthology.orchestra.run.smithi071.stdout:3325 read 0xcf3b7e7 thru 0xcf46744 (0xaf5e bytes) 2024-09-14T07:12:34.074 INFO:teuthology.orchestra.run.smithi071.stdout:3326 read 0xdab775 thru 0xdb1643 (0x5ecf bytes) 2024-09-14T07:12:34.090 INFO:teuthology.orchestra.run.smithi071.stdout:3327 trunc from 0xe566f56 to 0x1682cf2 2024-09-14T07:12:34.108 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:34.107+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158444929, 2024-09-14T07:12:34.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.197 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:34.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:12:34.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:12:34.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158419457000001, 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158407784, 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.211 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158397009, 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:34.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158386468, 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:12:34.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:34.221 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158376000000001, 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:12:34.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158365487999999, 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:12:34.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:12:34.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.230 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.15835515, 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:12:34.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:12:34.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158344807000001, 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.236 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:12:34.240 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158326218999999, 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:12:34.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.245 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158315129, 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:12:34.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158304426999999, 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.250 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158283678, 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:34.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158257817000001, 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:12:34.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:12:34.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158237980999999, 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:12:34.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:12:34.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:34.268 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158212358, 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:12:34.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158173549000001, 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.273 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:12:34.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.158152879999999, 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.278 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:12:34.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.152791949999999, 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:12:34.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.152777395999999, 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:34.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:12:34.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.291 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:34.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:34.293 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:34.292+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:34.385 INFO:teuthology.orchestra.run.smithi071.stdout:3328 read 0x14a908 thru 0x1590f7 (0xe7f0 bytes) 2024-09-14T07:12:34.393 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:34.392+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:34.408 INFO:teuthology.orchestra.run.smithi071.stdout:3329 trunc from 0x1682cf2 to 0xdb86b03 2024-09-14T07:12:34.413 INFO:teuthology.orchestra.run.smithi071.stdout:3332 punch from 0x154383f to 0x1552aea, (0xf2ab bytes) 2024-09-14T07:12:34.413 INFO:teuthology.orchestra.run.smithi071.stdout:3334 write 0xc373a8a thru 0xc373f3b (0x4b2 bytes) 2024-09-14T07:12:34.416 INFO:teuthology.orchestra.run.smithi071.stdout:3335 read 0x312da09 thru 0x313382f (0x5e27 bytes) 2024-09-14T07:12:34.416 INFO:teuthology.orchestra.run.smithi071.stdout:3336 writesame 0x28fedb1 thru 0x290d4df data_size 0x1(0xe72f bytes) 2024-09-14T07:12:34.432 INFO:teuthology.orchestra.run.smithi071.stdout:3338 read 0x9544d0e thru 0x954dfc2 (0x92b5 bytes) 2024-09-14T07:12:34.432 INFO:teuthology.orchestra.run.smithi071.stdout:3339 write 0x127bb97 thru 0x127d1d3 (0x163d bytes) 2024-09-14T07:12:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:34.450 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:34.450 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:34.450 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:34.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:34.476 INFO:teuthology.orchestra.run.smithi071.stdout:3341 read 0x96de505 thru 0x96ee196 (0xfc92 bytes) 2024-09-14T07:12:34.476 INFO:teuthology.orchestra.run.smithi071.stdout:3342 write 0xcb83946 thru 0xcb85b57 (0x2212 bytes) 2024-09-14T07:12:34.486 INFO:teuthology.orchestra.run.smithi071.stdout:3343 read 0x66e4f63 thru 0x66f2f04 (0xdfa2 bytes) 2024-09-14T07:12:34.486 INFO:teuthology.orchestra.run.smithi071.stdout:3345 read 0x91ce733 thru 0x91d730a (0x8bd8 bytes) 2024-09-14T07:12:34.486 INFO:teuthology.orchestra.run.smithi071.stdout:3348 read 0x57021ba thru 0x57093b1 (0x71f8 bytes) 2024-09-14T07:12:34.486 INFO:teuthology.orchestra.run.smithi071.stdout:3349 write 0x1f0648e thru 0x1f1407c (0xdbef bytes) 2024-09-14T07:12:34.494 INFO:teuthology.orchestra.run.smithi071.stdout:3350 write 0x82d68e0 thru 0x82de78f (0x7eb0 bytes) 2024-09-14T07:12:34.494 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:34.493+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:34.501 INFO:teuthology.orchestra.run.smithi071.stdout:3352 writesame 0x55f4779 thru 0x55f54bc data_size 0x6(0xd44 bytes) 2024-09-14T07:12:34.506 INFO:teuthology.orchestra.run.smithi071.stdout:3353 read 0x951bd14 thru 0x951e61f (0x290c bytes) 2024-09-14T07:12:34.506 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.506 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.506 INFO:teuthology.orchestra.run.smithi071.stdout:3356 write 0x33280ea thru 0x332d077 (0x4f8e bytes) 2024-09-14T07:12:34.519 INFO:teuthology.orchestra.run.smithi071.stdout:3358 writesame 0xe58e9f2 thru 0xe59c709 data_size 0x64(0xdd18 bytes) 2024-09-14T07:12:34.519 INFO:teuthology.orchestra.run.smithi071.stdout:3359 read 0x88b5638 thru 0x88c0618 (0xafe1 bytes) 2024-09-14T07:12:34.519 INFO:teuthology.orchestra.run.smithi071.stdout:3360 write 0x3f6d0cb thru 0x3f7775c (0xa692 bytes) 2024-09-14T07:12:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:3362 read 0x9c1f953 thru 0x9c2e689 (0xed37 bytes) 2024-09-14T07:12:34.528 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.528 INFO:teuthology.orchestra.run.smithi071.stdout:3364 write 0x6187666 thru 0x6191054 (0x99ef bytes) 2024-09-14T07:12:34.537 INFO:teuthology.orchestra.run.smithi071.stdout:3365 read 0x3c6dca6 thru 0x3c6f4ac (0x1807 bytes) 2024-09-14T07:12:34.537 INFO:teuthology.orchestra.run.smithi071.stdout:3366 write 0x5b038b2 thru 0x5b09396 (0x5ae5 bytes) 2024-09-14T07:12:34.546 INFO:teuthology.orchestra.run.smithi071.stdout:3368 write 0x63b8e3 thru 0x647407 (0xbb25 bytes) 2024-09-14T07:12:34.595 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:34.594+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:34.599 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:34.599 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:34.599 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:34.599 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:34.599 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:34.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:34.695 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:34.695+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7823 3.4 e34/23 3:235cf235:::rbd_header.1182b13d849f:head v 34'32, mlcod=32'30)", 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.035548411000001, 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020025759999999998, 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732725+0000", 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732726+0000", 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6799999999999999e-07 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732731+0000", 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6119999999999998e-06 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732742+0000", 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.093e-05 2024-09-14T07:12:34.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732748+0000", 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4990000000000002e-06 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732790+0000", 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531000000000003e-05 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.732803+0000", 2024-09-14T07:12:34.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3135999999999999e-05 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734693+0000", 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889967 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.734727+0000", 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4032999999999998e-05 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7864 3.9 e34/23 3:9662e057:::rbd_data.1182a7d91484.0000000000000022:head v 34'31, mlcod=32'28)", 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.00795922, 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020061520000000002, 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760314+0000", 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9799999999999999e-07 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760325+0000", 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0907000000000001e-05 2024-09-14T07:12:34.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760333+0000", 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2150000000000001e-06 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760348+0000", 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5026e-05 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760405+0000", 2024-09-14T07:12:34.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6885999999999997e-05 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.760426+0000", 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0265e-05 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762272+0000", 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001846349 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762320+0000", 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8106000000000003e-05 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7866 3.4 e34/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:head v 34'37, mlcod=34'34)", 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.006034554999999, 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026596739999999999, 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.779 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762266+0000", 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7076e-05 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762280+0000", 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4004e-05 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762288+0000", 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.678e-06 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762339+0000", 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0430000000000003e-05 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762357+0000", 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8850000000000001e-05 2024-09-14T07:12:34.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764858+0000", 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004010000000002 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764898+0000", 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0414000000000003e-05 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.001409958, 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:34.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:34.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.000311068999999, 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:34.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7905 3.4 e34/23 3:20b4893f:::rbd_data.1182a7d91484.0000000000000013:head v 34'39, mlcod=34'35)", 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.976121656, 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00219133, 2024-09-14T07:12:34.793 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792151+0000", 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792152+0000", 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792161+0000", 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3809999999999999e-06 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792177+0000", 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5838e-05 2024-09-14T07:12:34.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792185+0000", 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9400000000000002e-06 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792248+0000", 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2928000000000005e-05 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.792268+0000", 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0404999999999999e-05 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794300+0000", 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020316819999999999 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.794343+0000", 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3183999999999999e-05 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.97346791, 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.798 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12482 3.0 e37/23 3:04a1ed04:::rbd_data.1182a59bd9ad.0000000000000028:head v 37'42, mlcod=37'39)", 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.686657903, 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028333389999999998, 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081616+0000", 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7300000000000005e-07 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081622+0000", 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081638+0000", 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6429000000000001e-05 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081646+0000", 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.622e-06 2024-09-14T07:12:34.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081706+0000", 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9840000000000003e-05 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081724+0000", 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8150000000000001e-05 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084410+0000", 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026862029999999999 2024-09-14T07:12:34.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084449+0000", 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8342e-05 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.960173905000001, 2024-09-14T07:12:34.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:34.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:34.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.960104490999999, 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:34.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.816 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.119726465999999, 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.944135228, 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:12:34.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:12:34.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:12:34.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.654070332, 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:12:34.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.650042033999998, 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:34.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:12:34.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:12:34.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:12:34.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:12:34.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:12:34.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:12:34.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:12:34.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:12:34.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:12:34.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:12:34.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:12:34.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.429042911, 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:12:34.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.425525100000002, 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:12:34.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43971 3.4 e50/23 3:278d3374:::rbd_data.1182f9393092.0000000000000022:head v 50'120, mlcod=49'118)", 2024-09-14T07:12:34.850 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.888108268, 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002152686, 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880165+0000", 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880166+0000", 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.437e-06 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880415+0000", 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024896599999999999 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880433+0000", 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7768999999999999e-05 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880442+0000", 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.312e-06 2024-09-14T07:12:34.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880509+0000", 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6548e-05 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.880532+0000", 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3351000000000001e-05 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.882279+0000", 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017470490000000001 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.882318+0000", 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8254000000000003e-05 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43989 3.9 e51/23 3:93226f4f:::rbd_data.1182f9393092.0000000000000076:head v 51'118, mlcod=49'115)", 2024-09-14T07:12:34.855 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.962573247, 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029103520000000002, 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805706+0000", 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3510000000000001e-06 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805722+0000", 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6087999999999999e-05 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805734+0000", 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.259e-05 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805837+0000", 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103168 2024-09-14T07:12:34.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805855+0000", 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8048000000000001e-05 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808571+0000", 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027152500000000002 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808610+0000", 2024-09-14T07:12:34.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9530000000000003e-05 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:51333 3.9 e57/23 3:9413946a:::rbd_data.1182a686210f.0000000000000003:head v 57'147, mlcod=57'145)", 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:29.436736+0000", 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3315367309999999, 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019941070000000002, 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.436736+0000", 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.436736+0000", 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.436737+0000", 2024-09-14T07:12:34.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6799999999999999e-07 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437299+0000", 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056182599999999997 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437315+0000", 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5999e-05 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437323+0000", 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9969999999999998e-06 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437396+0000", 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250999999999994e-05 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437416+0000", 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9406e-05 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.438685+0000", 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012696000000000001 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.438730+0000", 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5160000000000001e-05 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.864 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:51334 3.4 e57/23 3:2318b1b3:::rbd_data.1182a686210f.0000000000000004:head v 57'379, mlcod=57'376)", 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3308805919999998, 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026042299999999999, 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:34.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:34.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6000000000000003e-07 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437629+0000", 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023561 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437638+0000", 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4849999999999998e-06 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:34.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437644+0000", 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2220000000000001e-06 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437699+0000", 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5603000000000003e-05 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437720+0000", 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0948e-05 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.439965+0000", 2024-09-14T07:12:34.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022452449999999999 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.439997+0000", 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1356999999999998e-05 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:34.870 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:34.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3369 trunc from 0xe59c70a to 0x1edd271 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3371 punch from 0x221b97 to 0x2230b5, (0x151e bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3373 punch from 0x111657c to 0x11165b2, (0x36 bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3375 writesame 0x38800ac thru 0x3889680 data_size 0xb(0x95d5 bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3376 read 0x2492 thru 0xb3b6 (0x8f25 bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3377 writesame 0x747f26a thru 0x748ea24 data_size 0x1(0xf7bb bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3378 trunc from 0x748ea25 to 0x816a698 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3381 read 0x110a522 thru 0x1113a68 (0x9547 bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3387 read 0x29bcb9b thru 0x29c9f4c (0xd3b2 bytes) 2024-09-14T07:12:34.874 INFO:teuthology.orchestra.run.smithi071.stdout:3390 write 0xc8d08b3 thru 0xc8d21e5 (0x1933 bytes) 2024-09-14T07:12:34.875 INFO:teuthology.orchestra.run.smithi071.stdout:3391 writesame 0xcd38ff3 thru 0xcd3e820 data_size 0x1(0x582e bytes) 2024-09-14T07:12:34.875 INFO:teuthology.orchestra.run.smithi071.stdout:3392 read 0x18e93e thru 0x197f9e (0x9661 bytes) 2024-09-14T07:12:34.875 INFO:teuthology.orchestra.run.smithi071.stdout:3393 trunc from 0xcd3e821 to 0x8e4e766 2024-09-14T07:12:34.875 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:34.871+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:34.876 INFO:teuthology.orchestra.run.smithi071.stdout:3395 read 0x4f3a9f3 thru 0x4f44b43 (0xa151 bytes) 2024-09-14T07:12:34.876 INFO:teuthology.orchestra.run.smithi071.stdout:3396 punch from 0x7d2f9e1 to 0x7d31763, (0x1d82 bytes) 2024-09-14T07:12:34.876 INFO:teuthology.orchestra.run.smithi071.stdout:3398 write 0x2fe433d thru 0x2fe53f6 (0x10ba bytes) 2024-09-14T07:12:34.879 INFO:teuthology.orchestra.run.smithi071.stdout:3399 punch from 0x34c3c6f to 0x34d31de, (0xf56f bytes) 2024-09-14T07:12:34.879 INFO:teuthology.orchestra.run.smithi071.stdout:3400 write 0xc3c30b thru 0xc4be53 (0xfb49 bytes) 2024-09-14T07:12:34.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:12:34.973 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:34.972+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:35.007 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:60515 3.7 3:e2ab73c5:::rbd_data.1182eddd9afc.000000000000001b:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 524288 write_size 524288,write 258827~9461 in=9461b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:35.007035+0000", 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00031159599999999998, 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033233299999999998, 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 60515 2024-09-14T07:12:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007035+0000", 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007035+0000", 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007037+0000", 2024-09-14T07:12:35.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.052e-06 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007049+0000", 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2105e-05 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007064+0000", 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4754e-05 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007071+0000", 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2579999999999998e-06 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007141+0000", 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9758000000000005e-05 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.007297+0000", 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015546099999999999 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.012 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:35.012 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-09-14T07:12:35.012 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:35.012 INFO:teuthology.orchestra.run.smithi071.stdout:3401 punch from 0x7e2662 to 0x7e3325, (0xcc3 bytes) 2024-09-14T07:12:35.014 INFO:teuthology.orchestra.run.smithi071.stdout:3402 write 0x9bafa27 thru 0x9bb2242 (0x281c bytes) 2024-09-14T07:12:35.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:35.027 INFO:teuthology.orchestra.run.smithi071.stdout:3403 read 0x1a6bf76 thru 0x1a75062 (0x90ed bytes) 2024-09-14T07:12:35.027 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.028 INFO:teuthology.orchestra.run.smithi071.stdout:3405 read 0x447d43f thru 0x4482175 (0x4d37 bytes) 2024-09-14T07:12:35.028 INFO:teuthology.orchestra.run.smithi071.stdout:3406 read 0x61d5ea6 thru 0x61e3563 (0xd6be bytes) 2024-09-14T07:12:35.028 INFO:teuthology.orchestra.run.smithi071.stdout:3407 writesame 0x757fc03 thru 0x758a569 data_size 0x1(0xa967 bytes) 2024-09-14T07:12:35.042 INFO:teuthology.orchestra.run.smithi071.stdout:3408 trunc from 0x9bb2243 to 0x926baad 2024-09-14T07:12:35.053 INFO:teuthology.orchestra.run.smithi071.stdout:3409 read 0x345e142 thru 0x3461437 (0x32f6 bytes) 2024-09-14T07:12:35.053 INFO:teuthology.orchestra.run.smithi071.stdout:3410 read 0x428e088 thru 0x429c2e3 (0xe25c bytes) 2024-09-14T07:12:35.061 INFO:teuthology.orchestra.run.smithi071.stdout:3411 trunc from 0x926baad to 0x2a4a473 2024-09-14T07:12:35.074 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:35.073+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:35.075 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.090 INFO:teuthology.orchestra.run.smithi071.stdout:3413 write 0xb2b0731 thru 0xb2bdad4 (0xd3a4 bytes) 2024-09-14T07:12:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:3414 punch from 0x746bced to 0x747b252, (0xf565 bytes) 2024-09-14T07:12:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:3416 read 0x2d52579 thru 0x2d61a4d (0xf4d5 bytes) 2024-09-14T07:12:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:3419 writesame 0x83375d9 thru 0x8341267 data_size 0x1(0x9c8f bytes) 2024-09-14T07:12:35.118 INFO:teuthology.orchestra.run.smithi071.stdout:3421 write 0x43508f8 thru 0x435896e (0x8077 bytes) 2024-09-14T07:12:35.129 INFO:teuthology.orchestra.run.smithi071.stdout:3422 write 0xa448ff3 thru 0xa458516 (0xf524 bytes) 2024-09-14T07:12:35.139 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:35.139 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:35.139 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:35.139 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:35.140 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:35.143 INFO:teuthology.orchestra.run.smithi071.stdout:3423 write 0x1335931 thru 0x133f2e7 (0x99b7 bytes) 2024-09-14T07:12:35.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:35.182 INFO:teuthology.orchestra.run.smithi071.stdout:3424 writesame 0x64b4b42 thru 0x64bb92b data_size 0xb(0x6dea bytes) 2024-09-14T07:12:35.182 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:35.181+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:35.189 INFO:teuthology.orchestra.run.smithi071.stdout:3425 read 0x200ce3b thru 0x2013119 (0x62df bytes) 2024-09-14T07:12:35.189 INFO:teuthology.orchestra.run.smithi071.stdout:3426 write 0x2801ad8 thru 0x280a37e (0x88a7 bytes) 2024-09-14T07:12:35.197 INFO:teuthology.orchestra.run.smithi071.stdout:3427 writesame 0x6e5f95e thru 0x6e5fd8e data_size 0x1(0x431 bytes) 2024-09-14T07:12:35.200 INFO:teuthology.orchestra.run.smithi071.stdout:3428 punch from 0x47466ec to 0x474e131, (0x7a45 bytes) 2024-09-14T07:12:35.200 INFO:teuthology.orchestra.run.smithi071.stdout:3429 punch from 0x4c9e5b9 to 0x4ca1e13, (0x385a bytes) 2024-09-14T07:12:35.201 INFO:teuthology.orchestra.run.smithi071.stdout:3431 read 0x53472d6 thru 0x534896e (0x1699 bytes) 2024-09-14T07:12:35.201 INFO:teuthology.orchestra.run.smithi071.stdout:3432 punch from 0x6878bb7 to 0x6878fe5, (0x42e bytes) 2024-09-14T07:12:35.201 INFO:teuthology.orchestra.run.smithi071.stdout:3433 punch from 0x3cb5f90 to 0x3cba197, (0x4207 bytes) 2024-09-14T07:12:35.201 INFO:teuthology.orchestra.run.smithi071.stdout:3434 punch from 0x88d5f23 to 0x88e4483, (0xe560 bytes) 2024-09-14T07:12:35.207 INFO:teuthology.orchestra.run.smithi071.stdout:3438 writesame 0xbb40bca thru 0xbb43e0c data_size 0x1(0x3243 bytes) 2024-09-14T07:12:35.207 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.207 INFO:teuthology.orchestra.run.smithi071.stdout:3442 write 0x41087bc thru 0x4111c40 (0x9485 bytes) 2024-09-14T07:12:35.214 INFO:teuthology.orchestra.run.smithi071.stdout:3444 read 0x44eb06c thru 0x44ed914 (0x28a9 bytes) 2024-09-14T07:12:35.216 INFO:teuthology.orchestra.run.smithi071.stdout:3446 trunc from 0xbb43e0d to 0xade5aeb 2024-09-14T07:12:35.228 INFO:teuthology.orchestra.run.smithi071.stdout:3447 trunc from 0xade5aeb to 0xc482e40 2024-09-14T07:12:35.233 INFO:teuthology.orchestra.run.smithi071.stdout:3449 write 0x385a9b5 thru 0x3861684 (0x6cd0 bytes) 2024-09-14T07:12:35.246 INFO:teuthology.orchestra.run.smithi071.stdout:3451 read 0x91e5392 thru 0x91f3c5f (0xe8ce bytes) 2024-09-14T07:12:35.246 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.246 INFO:teuthology.orchestra.run.smithi071.stdout:3453 write 0xf17f6b thru 0xf24045 (0xc0db bytes) 2024-09-14T07:12:35.259 INFO:teuthology.orchestra.run.smithi071.stdout:3455 write 0x9a6b8b thru 0x9a8655 (0x1acb bytes) 2024-09-14T07:12:35.276 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:35.275+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:35.317 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:35.317 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.347003728000001, 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:12:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:12:35.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:12:35.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346971375999999, 2024-09-14T07:12:35.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:35.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:12:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346886725000001, 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:35.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346861365999999, 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:12:35.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346828658, 2024-09-14T07:12:35.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:12:35.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346796533999999, 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:12:35.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:35.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:12:35.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346765116, 2024-09-14T07:12:35.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346741146999999, 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346721449, 2024-09-14T07:12:35.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:35.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:12:35.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:12:35.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346707507000001, 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:35.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346696276999999, 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:35.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346685148999999, 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:12:35.369 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:35.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346673986999999, 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:12:35.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:12:35.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.378 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346663276000001, 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:12:35.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346653569000001, 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:35.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.387 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346644005000002, 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:12:35.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:12:35.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346634669, 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.392 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.396 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346624476999999, 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:12:35.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:12:35.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.3466041, 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.401 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:12:35.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.346558055999999, 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:12:35.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:35.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:35.410 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:35.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:35.413 INFO:teuthology.orchestra.run.smithi071.stdout:3456 writesame 0x1856823 thru 0x1862ddf data_size 0x1(0xc5bd bytes) 2024-09-14T07:12:35.413 INFO:teuthology.orchestra.run.smithi071.stdout:3457 punch from 0x35c02a8 to 0x35c71c4, (0x6f1c bytes) 2024-09-14T07:12:35.413 INFO:teuthology.orchestra.run.smithi071.stdout:3458 read 0x41bb511 thru 0x41be243 (0x2d33 bytes) 2024-09-14T07:12:35.414 INFO:teuthology.orchestra.run.smithi071.stdout:3459 write 0x975a949 thru 0x9766206 (0xb8be bytes) 2024-09-14T07:12:35.414 INFO:teuthology.orchestra.run.smithi071.stdout:3460 read 0x94dd4cb thru 0x94eb066 (0xdb9c bytes) 2024-09-14T07:12:35.414 INFO:teuthology.orchestra.run.smithi071.stdout:3463 read 0x1e13881 thru 0x1e204d5 (0xcc55 bytes) 2024-09-14T07:12:35.414 INFO:teuthology.orchestra.run.smithi071.stdout:3464 read 0x588e60e thru 0x589c2ad (0xdca0 bytes) 2024-09-14T07:12:35.414 INFO:teuthology.orchestra.run.smithi071.stdout:3466 read 0x18f2831 thru 0x18f7d86 (0x5556 bytes) 2024-09-14T07:12:35.414 INFO:teuthology.orchestra.run.smithi071.stdout:3467 write 0xca25b56 thru 0xca3567d (0xfb28 bytes) 2024-09-14T07:12:35.414 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:35.411+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:35.415 INFO:teuthology.orchestra.run.smithi071.stdout:3468 read 0x8d7ec7c thru 0x8d8d07e (0xe403 bytes) 2024-09-14T07:12:35.415 INFO:teuthology.orchestra.run.smithi071.stdout:3469 punch from 0x10448fb to 0x104fc9d, (0xb3a2 bytes) 2024-09-14T07:12:35.415 INFO:teuthology.orchestra.run.smithi071.stdout:3470 read 0x9244be7 thru 0x9250665 (0xba7f bytes) 2024-09-14T07:12:35.415 INFO:teuthology.orchestra.run.smithi071.stdout:3471 writesame 0x49a7d7b thru 0x49aceab data_size 0x1(0x5131 bytes) 2024-09-14T07:12:35.427 INFO:teuthology.orchestra.run.smithi071.stdout:3472 writesame 0x4c80ea6 thru 0x4c81dc5 data_size 0x10(0xf20 bytes) 2024-09-14T07:12:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:3473 punch from 0xa674317 to 0xa678bfb, (0x48e4 bytes) 2024-09-14T07:12:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:3476 write 0x68926b8 thru 0x68a0425 (0xdd6e bytes) 2024-09-14T07:12:35.439 INFO:teuthology.orchestra.run.smithi071.stdout:3477 read 0x3c3d462 thru 0x3c45453 (0x7ff2 bytes) 2024-09-14T07:12:35.439 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.439 INFO:teuthology.orchestra.run.smithi071.stdout:3479 write 0x20e0197 thru 0x20efbc4 (0xfa2e bytes) 2024-09-14T07:12:35.447 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:35.447 INFO:teuthology.orchestra.run.smithi071.stdout:3481 trunc from 0xca3567e to 0xcebc725 2024-09-14T07:12:35.452 INFO:teuthology.orchestra.run.smithi071.stdout:3482 punch from 0x1974e8b to 0x1977b98, (0x2d0d bytes) 2024-09-14T07:12:35.453 INFO:teuthology.orchestra.run.smithi071.stdout:3483 read 0xc63f432 thru 0xc6435ba (0x4189 bytes) 2024-09-14T07:12:35.453 INFO:teuthology.orchestra.run.smithi071.stdout:3484 write 0x5e12033 thru 0x5e13a3b (0x1a09 bytes) 2024-09-14T07:12:35.458 INFO:teuthology.orchestra.run.smithi071.stdout:3485 read 0x14b044c thru 0x14c00b1 (0xfc66 bytes) 2024-09-14T07:12:35.458 INFO:teuthology.orchestra.run.smithi071.stdout:3486 write 0xff1c0 thru 0x10daad (0xe8ee bytes) 2024-09-14T07:12:35.513 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:35.512+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:35.530 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:35.530 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:35.530 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:35.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:35.614 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:35.613+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:35.659 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:35.659 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:35.659 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:35.659 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:35.659 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:35.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:35.715 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:35.714+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:35.792 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20262 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932458441000001, 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055198311999999999, 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20262 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858249+0000", 2024-09-14T07:12:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9860000000000001e-06 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858256+0000", 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7460000000000003e-06 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858261+0000", 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6840000000000001e-06 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913197+0000", 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054935171999999997 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913239+0000", 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2460999999999999e-05 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913445+0000", 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205894 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20264 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:35.798 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932430354000001, 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055428349000000002, 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20264 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858282+0000", 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5640000000000002e-06 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858289+0000", 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5839999999999997e-06 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858292+0000", 2024-09-14T07:12:35.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913465+0000", 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055172959000000001 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913524+0000", 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8489000000000002e-05 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913703+0000", 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000179354 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20266 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 565248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932391260999999, 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055643262999999998, 2024-09-14T07:12:35.803 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20266 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:35.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7800000000000002e-07 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858316+0000", 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5570000000000001e-06 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858319+0000", 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5990000000000002e-06 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858322+0000", 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913743+0000", 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055421103999999999 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913797+0000", 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3492000000000002e-05 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913957+0000", 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000160457 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20267 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 622592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932379892, 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055883545, 2024-09-14T07:12:35.808 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20267 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9999999999999999e-07 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858326+0000", 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3699999999999999e-07 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858330+0000", 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2969999999999999e-06 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858332+0000", 2024-09-14T07:12:35.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6070000000000002e-06 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913986+0000", 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055653310999999997 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914028+0000", 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2678e-05 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914209+0000", 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018041500000000001 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20270 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 679936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932368163, 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056156692000000001, 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20270 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.39e-07 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858339+0000", 2024-09-14T07:12:35.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.697e-06 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858345+0000", 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6690000000000003e-06 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858349+0000", 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4089999999999996e-06 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914250+0000", 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055901301 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914304+0000", 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3331999999999997e-05 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914494+0000", 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018994500000000001 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20272 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 737280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932352013999999, 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056423736000000002, 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20272 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858354+0000", 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1039999999999999e-06 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858359+0000", 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.899e-06 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858363+0000", 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2409999999999997e-06 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914526+0000", 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163006000000001 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914568+0000", 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1937000000000002e-05 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914777+0000", 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020833399999999999 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20277 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932335787, 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056720242999999997, 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20277 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858370+0000", 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858372+0000", 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0229999999999999e-06 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858378+0000", 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858383+0000", 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3489999999999999e-06 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914816+0000", 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056432942999999999 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914877+0000", 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0627000000000001e-05 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915089+0000", 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021294400000000001 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20280 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 851968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932315844000001, 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056953472999999998, 2024-09-14T07:12:35.828 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20280 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858390+0000", 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:35.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858392+0000", 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0899999999999999e-06 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858398+0000", 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9399999999999999e-06 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858403+0000", 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.074e-06 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915119+0000", 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056716338999999998 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915164+0000", 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4642999999999999e-05 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915343+0000", 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017900199999999999 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20281 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 569344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932296180000002, 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057219575000000002, 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20281 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000003e-07 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858411+0000", 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9199999999999998e-06 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858417+0000", 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7729999999999996e-06 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858422+0000", 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7180000000000004e-06 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915373+0000", 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056951193999999997 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915414+0000", 2024-09-14T07:12:35.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1301000000000003e-05 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915628+0000", 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214095 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20282 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 909312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:35.838 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932277298999999, 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057564303999999997, 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20282 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:35.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858430+0000", 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858436+0000", 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7189999999999998e-06 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858440+0000", 2024-09-14T07:12:35.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.651e-06 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915664+0000", 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057223759999999999 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915761+0000", 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7372000000000002e-05 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915992+0000", 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023059099999999999 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20283 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 626688~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932258716, 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057833405999999997, 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20283 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858447+0000", 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2900000000000004e-07 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858449+0000", 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0020000000000001e-06 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858454+0000", 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3809999999999998e-06 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858459+0000", 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4889999999999997e-06 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916036+0000", 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057576910000000002 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916116+0000", 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0643999999999996e-05 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916280+0000", 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000163451 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20284 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932240355000001, 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058094858999999999, 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20284 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858467+0000", 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.874e-06 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858472+0000", 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5629999999999999e-06 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858477+0000", 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7910000000000004e-06 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916311+0000", 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057833757999999999 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916358+0000", 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7018999999999998e-05 2024-09-14T07:12:35.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916560+0000", 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201454 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.853 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20285 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 684032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932222377999999, 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058354537999999997, 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20285 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.854 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:35.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858485+0000", 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858490+0000", 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9729999999999997e-06 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858493+0000", 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6059999999999999e-06 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916588+0000", 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058094693000000003 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916673+0000", 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4994000000000007e-05 2024-09-14T07:12:35.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916837+0000", 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016414199999999999 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20286 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.93220629, 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058559422999999999, 2024-09-14T07:12:35.858 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20286 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4099999999999999e-07 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858505+0000", 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6699999999999999e-06 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858511+0000", 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2990000000000002e-06 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858516+0000", 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0379999999999999e-06 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916866+0000", 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058349491000000003 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916919+0000", 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3811999999999999e-05 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917058+0000", 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000138672 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20287 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 741376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932163536000001, 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058806793000000003, 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20287 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858542+0000", 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5400000000000001e-07 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858544+0000", 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.272e-06 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858550+0000", 2024-09-14T07:12:35.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6980000000000003e-06 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858553+0000", 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9450000000000002e-06 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917093+0000", 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058540433000000003 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917189+0000", 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5525000000000004e-05 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917348+0000", 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159266 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20298 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 798720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932146651, 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059061633000000002, 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20298 2024-09-14T07:12:35.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858559+0000", 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7199999999999999e-07 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858560+0000", 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.641e-06 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858565+0000", 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1350000000000002e-06 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917378+0000", 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058810442999999997 2024-09-14T07:12:35.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917423+0000", 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4756999999999999e-05 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917620+0000", 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000197424 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20301 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 856064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932134317999999, 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059306867999999999, 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20301 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:35.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858572+0000", 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.085e-06 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858575+0000", 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9289999999999998e-06 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858578+0000", 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917659+0000", 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059081394000000002 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917734+0000", 2024-09-14T07:12:35.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5426000000000006e-05 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917878+0000", 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014318999999999999 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20303 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:35.878 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932124219999999, 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059649109999999998, 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20303 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:35.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858582+0000", 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1800000000000004e-07 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858585+0000", 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.796e-06 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858588+0000", 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.044e-06 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917920+0000", 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059332480999999999 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918010+0000", 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9884999999999997e-05 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918230+0000", 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021977300000000001 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.883 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20305 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 970752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932114511999998, 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059866838999999998, 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.884 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20305 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858591+0000", 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858592+0000", 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858594+0000", 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7779999999999999e-06 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858597+0000", 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3609999999999999e-06 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918253+0000", 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059656265 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918296+0000", 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2963999999999997e-05 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918457+0000", 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016128900000000001 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.888 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20307 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1028096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.932105613000001, 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.060103704000000001, 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20307 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:35.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858600+0000", 2024-09-14T07:12:35.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1199999999999999e-07 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858600+0000", 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9100000000000002e-07 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4819999999999999e-06 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858606+0000", 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3709999999999998e-06 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918494+0000", 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059887915999999999 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918542+0000", 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7661000000000003e-05 2024-09-14T07:12:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918703+0000", 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016117099999999999 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:35.893 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:35.895 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:12:35.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:35.896 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:35.893+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:35.972 INFO:teuthology.orchestra.run.smithi071.stdout:3488 trunc from 0xcebc725 to 0x4c6bcb0 2024-09-14T07:12:35.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:35.999 INFO:teuthology.orchestra.run.smithi071.stdout:3489 read 0x28f5c0c thru 0x28feba5 (0x8f9a bytes) 2024-09-14T07:12:36.000 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:35.999+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:36.000 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:36.007 INFO:teuthology.orchestra.run.smithi071.stdout:3493 write 0x6aef14a thru 0x6af2b52 (0x3a09 bytes) 2024-09-14T07:12:36.008 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:36.008 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:36.008 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:36.008 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:36.015 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:36.015 INFO:teuthology.orchestra.run.smithi071.stdout:3496 write 0x44ae75c thru 0x44b6c6f (0x8514 bytes) 2024-09-14T07:12:36.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:36.023 INFO:teuthology.orchestra.run.smithi071.stdout:3499 writesame 0x70bb974 thru 0x70bf91c data_size 0x1(0x3fa9 bytes) 2024-09-14T07:12:36.023 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:36.023 INFO:teuthology.orchestra.run.smithi071.stdout:3504 read 0xbe748 thru 0xbf6ab (0xf64 bytes) 2024-09-14T07:12:36.024 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:36.033 INFO:teuthology.orchestra.run.smithi071.stdout:3506 writesame 0xa33f8b7 thru 0xa3412d7 data_size 0x1(0x1a21 bytes) 2024-09-14T07:12:36.033 INFO:teuthology.orchestra.run.smithi071.stdout:3507 write 0xf65728 thru 0xf71e41 (0xc71a bytes) 2024-09-14T07:12:36.045 INFO:teuthology.orchestra.run.smithi071.stdout:3508 trunc from 0xa3412d8 to 0x1ce6ad5 2024-09-14T07:12:36.064 INFO:teuthology.orchestra.run.smithi071.stdout:3509 punch from 0x145df50 to 0x1460362, (0x2412 bytes) 2024-09-14T07:12:36.064 INFO:teuthology.orchestra.run.smithi071.stdout:3510 writesame 0x1ad3c4b thru 0x1ae20f4 data_size 0x1(0xe4aa bytes) 2024-09-14T07:12:36.078 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:36.087 INFO:teuthology.orchestra.run.smithi071.stdout:3512 trunc from 0x1ce6ad5 to 0x95e5552 2024-09-14T07:12:36.096 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:36.095+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:36.104 INFO:teuthology.orchestra.run.smithi071.stdout:3513 write 0xee29795 thru 0xee2c6a6 (0x2f12 bytes) 2024-09-14T07:12:36.112 INFO:teuthology.orchestra.run.smithi071.stdout:3514 clone 26 order 22 su 16384 sc 2 2024-09-14T07:12:36.118 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:36.118 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:36.134 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:36.134 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:36.134 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:36.135 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:36.135 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:36.135 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:36.136 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:36.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:36.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:36.152 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:36.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:36.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:36.182 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:36.197 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:36.196+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:36.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:36.199 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:36.216 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:36.216 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:36.219 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:36.219 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.246 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.255 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:36.298 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:36.298+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:36.358 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.358 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:36.399 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:36.399+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:36.467 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.467 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:36.519 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:36.518+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:36.577 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.578 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:36.627 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:36.626+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:36.690 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.690 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:36.742 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:36.741+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:36.799 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.800 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.803 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:36.802+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:36.808 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:36.904 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:36.903+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:36.958 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:36.958 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:36.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:36.978 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone25 from 0xee2c6a7 (overlap 0x1682cf2) to 0xd81af7 2024-09-14T07:12:37.005 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:37.004+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:37.082 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.082 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:37.092 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-14T07:12:37.094 INFO:teuthology.orchestra.run.smithi071.stdout:3515 read 0xd9e3917 thru 0xd9f2b68 (0xf252 bytes) 2024-09-14T07:12:37.094 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.094 INFO:teuthology.orchestra.run.smithi071.stdout:3518 read 0xce6fae9 thru 0xce7b652 (0xbb6a bytes) 2024-09-14T07:12:37.094 INFO:teuthology.orchestra.run.smithi071.stdout:3519 read 0x411adc6 thru 0x411bb50 (0xd8b bytes) 2024-09-14T07:12:37.100 INFO:teuthology.orchestra.run.smithi071.stdout:3521 trunc from 0xee2c6a7 to 0xaa80277 2024-09-14T07:12:37.106 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:37.105+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:37.122 INFO:teuthology.orchestra.run.smithi071.stdout:3523 write 0x8d40393 thru 0x8d4ad72 (0xa9e0 bytes) 2024-09-14T07:12:37.142 INFO:teuthology.orchestra.run.smithi071.stdout:3525 trunc from 0xaa80277 to 0x97e5a85 2024-09-14T07:12:37.165 INFO:teuthology.orchestra.run.smithi071.stdout:3526 read 0x12cd6e3 thru 0x12d114e (0x3a6c bytes) 2024-09-14T07:12:37.167 INFO:teuthology.orchestra.run.smithi071.stdout:3527 read 0x85c32df thru 0x85c3817 (0x539 bytes) 2024-09-14T07:12:37.167 INFO:teuthology.orchestra.run.smithi071.stdout:3528 punch from 0x78ac496 to 0x78bab2a, (0xe694 bytes) 2024-09-14T07:12:37.167 INFO:teuthology.orchestra.run.smithi071.stdout:3529 read 0x79cafdd thru 0x79cb69e (0x6c2 bytes) 2024-09-14T07:12:37.171 INFO:teuthology.orchestra.run.smithi071.stdout:3531 trunc from 0x97e5a85 to 0x5f33cb9 2024-09-14T07:12:37.191 INFO:teuthology.orchestra.run.smithi071.stdout:3532 read 0x179175c thru 0x179b099 (0x993e bytes) 2024-09-14T07:12:37.206 INFO:teuthology.orchestra.run.smithi071.stdout:3536 write 0xd8c8c9c thru 0xd8d7e64 (0xf1c9 bytes) 2024-09-14T07:12:37.206 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:37.206+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:37.209 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.209 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.209 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.215 INFO:teuthology.orchestra.run.smithi071.stdout:3540 writesame 0xe8b3193 thru 0xe8b31d8 data_size 0x1(0x46 bytes) 2024-09-14T07:12:37.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:37.220 INFO:teuthology.orchestra.run.smithi071.stdout:3541 write 0xec6f392 thru 0xec781e2 (0x8e51 bytes) 2024-09-14T07:12:37.224 INFO:teuthology.orchestra.run.smithi071.stdout:3542 write 0x3b1e1fb thru 0x3b23bbe (0x59c4 bytes) 2024-09-14T07:12:37.236 INFO:teuthology.orchestra.run.smithi071.stdout:3544 write 0x5973976 thru 0x597bba5 (0x8230 bytes) 2024-09-14T07:12:37.237 INFO:teuthology.orchestra.run.smithi071.stdout:3545 write 0x362ce0b thru 0x3632756 (0x594c bytes) 2024-09-14T07:12:37.251 INFO:teuthology.orchestra.run.smithi071.stdout:3546 writesame 0xc501db7 thru 0xc50a996 data_size 0x30(0x8be0 bytes) 2024-09-14T07:12:37.255 INFO:teuthology.orchestra.run.smithi071.stdout:3547 writesame 0xb41db97 thru 0xb42bbf0 data_size 0x2f(0xe05a bytes) 2024-09-14T07:12:37.258 INFO:teuthology.orchestra.run.smithi071.stdout:3549 read 0x41c51f4 thru 0x41c84eb (0x32f8 bytes) 2024-09-14T07:12:37.276 INFO:teuthology.orchestra.run.smithi071.stdout:3551 trunc from 0xec781e3 to 0xa570e 2024-09-14T07:12:37.307 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:37.306+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:37.365 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.365 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:37.420 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:37.419+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:37.472 INFO:teuthology.orchestra.run.smithi071.stdout:3552 write 0x9cf7c09 thru 0x9d011b0 (0x95a8 bytes) 2024-09-14T07:12:37.475 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.475 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.475 INFO:teuthology.orchestra.run.smithi071.stdout:3558 write 0x5ed31dc thru 0x5ed499b (0x17c0 bytes) 2024-09-14T07:12:37.478 INFO:teuthology.orchestra.run.smithi071.stdout:3560 write 0x5cc1c3f thru 0x5cc6ec4 (0x5286 bytes) 2024-09-14T07:12:37.485 INFO:teuthology.orchestra.run.smithi071.stdout:3563 write 0xa50ee74 thru 0xa515261 (0x63ee bytes) 2024-09-14T07:12:37.489 INFO:teuthology.orchestra.run.smithi071.stdout:3564 write 0x736f9e thru 0x73b07a (0x40dd bytes) 2024-09-14T07:12:37.490 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.490 INFO:teuthology.orchestra.run.smithi071.stdout:3566 writesame 0x9e20ba3 thru 0x9e2e502 data_size 0x5e(0xd960 bytes) 2024-09-14T07:12:37.502 INFO:teuthology.orchestra.run.smithi071.stdout:3567 trunc from 0xa515262 to 0xe7b4f2 2024-09-14T07:12:37.509 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:37.509+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:37.513 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.519 INFO:teuthology.orchestra.run.smithi071.stdout:3569 trunc from 0xe7b4f2 to 0x65e4f89 2024-09-14T07:12:37.532 INFO:teuthology.orchestra.run.smithi071.stdout:3573 write 0x9884918 thru 0x98909b7 (0xc0a0 bytes) 2024-09-14T07:12:37.539 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.540 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.545 INFO:teuthology.orchestra.run.smithi071.stdout:3574 trunc from 0x98909b8 to 0x202d724 2024-09-14T07:12:37.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:37.567 INFO:teuthology.orchestra.run.smithi071.stdout:3575 write 0xa024bbc thru 0xa02ac69 (0x60ae bytes) 2024-09-14T07:12:37.570 INFO:teuthology.orchestra.run.smithi071.stdout:3576 write 0x9734e87 thru 0x9742881 (0xd9fb bytes) 2024-09-14T07:12:37.573 INFO:teuthology.orchestra.run.smithi071.stdout:3577 write 0x28b7d3c thru 0x28c1403 (0x96c8 bytes) 2024-09-14T07:12:37.577 INFO:teuthology.orchestra.run.smithi071.stdout:3579 writesame 0x865b0b thru 0x86f401 data_size 0x39(0x98f7 bytes) 2024-09-14T07:12:37.580 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.580 INFO:teuthology.orchestra.run.smithi071.stdout:3581 writesame 0x88c1341 thru 0x88cc2bf data_size 0x1(0xaf7f bytes) 2024-09-14T07:12:37.592 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.592 INFO:teuthology.orchestra.run.smithi071.stdout:3585 write 0x5d9221 thru 0x5d99af (0x78f bytes) 2024-09-14T07:12:37.593 INFO:teuthology.orchestra.run.smithi071.stdout:3586 writesame 0x8e3e1f4 thru 0x8e487cd data_size 0x47(0xa5da bytes) 2024-09-14T07:12:37.595 INFO:teuthology.orchestra.run.smithi071.stdout:3587 read 0x1024a1c thru 0x103287f (0xde64 bytes) 2024-09-14T07:12:37.595 INFO:teuthology.orchestra.run.smithi071.stdout:3588 read 0x28676dc thru 0x286bf3e (0x4863 bytes) 2024-09-14T07:12:37.595 INFO:teuthology.orchestra.run.smithi071.stdout:3589 write 0x8fe7215 thru 0x8fe7525 (0x311 bytes) 2024-09-14T07:12:37.599 INFO:teuthology.orchestra.run.smithi071.stdout:3591 trunc from 0xa02ac6a to 0x7b7ffba 2024-09-14T07:12:37.608 INFO:teuthology.orchestra.run.smithi071.stdout:3592 read 0xd1f456 thru 0xd249c3 (0x556e bytes) 2024-09-14T07:12:37.608 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.610 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:37.610+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:37.613 INFO:teuthology.orchestra.run.smithi071.stdout:3595 trunc from 0x7b7ffba to 0x39eb34c 2024-09-14T07:12:37.619 INFO:teuthology.orchestra.run.smithi071.stdout:3596 punch from 0x2d9ad5e to 0x2da5d70, (0xb012 bytes) 2024-09-14T07:12:37.628 INFO:teuthology.orchestra.run.smithi071.stdout:3598 writesame 0x6dfbae7 thru 0x6e0ac88 data_size 0x9d(0xf1a2 bytes) 2024-09-14T07:12:37.628 INFO:teuthology.orchestra.run.smithi071.stdout:3599 punch from 0x2c4f6f2 to 0x2c5cbd2, (0xd4e0 bytes) 2024-09-14T07:12:37.635 INFO:teuthology.orchestra.run.smithi071.stdout:3600 trunc from 0x6e0ac89 to 0xce09d5a 2024-09-14T07:12:37.641 INFO:teuthology.orchestra.run.smithi071.stdout:3601 write 0x4256757 thru 0x4259496 (0x2d40 bytes) 2024-09-14T07:12:37.659 INFO:teuthology.orchestra.run.smithi071.stdout:3602 trunc from 0xce09d5a to 0xdfcfcc 2024-09-14T07:12:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.673 INFO:teuthology.orchestra.run.smithi071.stdout:3603 trunc from 0xdfcfcc to 0x4a23274 2024-09-14T07:12:37.679 INFO:teuthology.orchestra.run.smithi071.stdout:3605 writesame 0x11812dc thru 0x11824cd data_size 0x1(0x11f2 bytes) 2024-09-14T07:12:37.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:37.683 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.696 INFO:teuthology.orchestra.run.smithi071.stdout:3608 write 0xc4d7f1e thru 0xc4dfde6 (0x7ec9 bytes) 2024-09-14T07:12:37.703 INFO:teuthology.orchestra.run.smithi071.stdout:3609 writesame 0x1a66ec2 thru 0x1a6ec05 data_size 0x2(0x7d44 bytes) 2024-09-14T07:12:37.711 INFO:teuthology.orchestra.run.smithi071.stdout:3610 writesame 0x4951dae thru 0x495b483 data_size 0x2(0x96d6 bytes) 2024-09-14T07:12:37.711 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:37.711+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:37.720 INFO:teuthology.orchestra.run.smithi071.stdout:3611 punch from 0x5cffe9b to 0x5d0e211, (0xe376 bytes) 2024-09-14T07:12:37.720 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.721 INFO:teuthology.orchestra.run.smithi071.stdout:3613 trunc from 0xc4dfde7 to 0xb32961c 2024-09-14T07:12:37.729 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.729 INFO:teuthology.orchestra.run.smithi071.stdout:3615 punch from 0x655e635 to 0x656e055, (0xfa20 bytes) 2024-09-14T07:12:37.729 INFO:teuthology.orchestra.run.smithi071.stdout:3616 punch from 0x6026e24 to 0x6030991, (0x9b6d bytes) 2024-09-14T07:12:37.740 INFO:teuthology.orchestra.run.smithi071.stdout:3617 trunc from 0xb32961c to 0x26d5a3c 2024-09-14T07:12:37.750 INFO:teuthology.orchestra.run.smithi071.stdout:3618 read 0x70e55b thru 0x71cdc0 (0xe866 bytes) 2024-09-14T07:12:37.750 INFO:teuthology.orchestra.run.smithi071.stdout:3619 read 0x26c0258 thru 0x26c997e (0x9727 bytes) 2024-09-14T07:12:37.750 INFO:teuthology.orchestra.run.smithi071.stdout:3621 read 0xe50f5a thru 0xe54a2e (0x3ad5 bytes) 2024-09-14T07:12:37.762 INFO:teuthology.orchestra.run.smithi071.stdout:3622 write 0x79f4cc3 thru 0x79fd349 (0x8687 bytes) 2024-09-14T07:12:37.780 INFO:teuthology.orchestra.run.smithi071.stdout:3623 write 0xe04dfec thru 0xe05cb92 (0xeba7 bytes) 2024-09-14T07:12:37.787 INFO:teuthology.orchestra.run.smithi071.stdout:3624 writesame 0xccc7729 thru 0xccccdf9 data_size 0x1(0x56d1 bytes) 2024-09-14T07:12:37.797 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.798 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.799 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.809 INFO:teuthology.orchestra.run.smithi071.stdout:3629 trunc from 0xe05cb93 to 0x41e56b8 2024-09-14T07:12:37.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:37.813 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:37.811+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:37.819 INFO:teuthology.orchestra.run.smithi071.stdout:3631 read 0x22b91e8 thru 0x22c2589 (0x93a2 bytes) 2024-09-14T07:12:37.823 INFO:teuthology.orchestra.run.smithi071.stdout:3632 trunc from 0x41e56b8 to 0x750725b 2024-09-14T07:12:37.835 INFO:teuthology.orchestra.run.smithi071.stdout:3633 write 0x80097f6 thru 0x8012af2 (0x92fd bytes) 2024-09-14T07:12:37.838 INFO:teuthology.orchestra.run.smithi071.stdout:3634 write 0x5d6360e thru 0x5d6da2a (0xa41d bytes) 2024-09-14T07:12:37.840 INFO:teuthology.orchestra.run.smithi071.stdout:3635 read 0x20b739c thru 0x20bb107 (0x3d6c bytes) 2024-09-14T07:12:37.841 INFO:teuthology.orchestra.run.smithi071.stdout:3636 write 0x68ae7be thru 0x68b085b (0x209e bytes) 2024-09-14T07:12:37.843 INFO:teuthology.orchestra.run.smithi071.stdout:3637 read 0x486b200 thru 0x48711cb (0x5fcc bytes) 2024-09-14T07:12:37.843 INFO:teuthology.orchestra.run.smithi071.stdout:3639 write 0x7913cc3 thru 0x7923556 (0xf894 bytes) 2024-09-14T07:12:37.847 INFO:teuthology.orchestra.run.smithi071.stdout:3640 punch from 0x1121c36 to 0x11279ab, (0x5d75 bytes) 2024-09-14T07:12:37.847 INFO:teuthology.orchestra.run.smithi071.stdout:3641 write 0x773d745 thru 0x774b734 (0xdff0 bytes) 2024-09-14T07:12:37.850 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.850 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.850 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.850 INFO:teuthology.orchestra.run.smithi071.stdout:3647 read 0x40f5c7f thru 0x40ff0f0 (0x9472 bytes) 2024-09-14T07:12:37.850 INFO:teuthology.orchestra.run.smithi071.stdout:3648 read 0x65155ad thru 0x651d51b (0x7f6f bytes) 2024-09-14T07:12:37.850 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:3651 punch from 0x3fb6116 to 0x3fbee9e, (0x8d88 bytes) 2024-09-14T07:12:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:3652 punch from 0x5fb749b to 0x5fbef04, (0x7a69 bytes) 2024-09-14T07:12:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:3653 read 0x4a72dd7 thru 0x4a76e44 (0x406e bytes) 2024-09-14T07:12:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:3655 read 0xf95d18 thru 0xf97824 (0x1b0d bytes) 2024-09-14T07:12:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:3656 read 0x3c3bce2 thru 0x3c46da6 (0xb0c5 bytes) 2024-09-14T07:12:37.853 INFO:teuthology.orchestra.run.smithi071.stdout:3659 trunc from 0x8012af3 to 0xadf9e9e 2024-09-14T07:12:37.858 INFO:teuthology.orchestra.run.smithi071.stdout:3661 write 0x8a074e4 thru 0x8a0b8f2 (0x440f bytes) 2024-09-14T07:12:37.861 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.862 INFO:teuthology.orchestra.run.smithi071.stdout:3663 read 0x8b4937a thru 0x8b55e11 (0xca98 bytes) 2024-09-14T07:12:37.862 INFO:teuthology.orchestra.run.smithi071.stdout:3664 writesame 0x76114ee thru 0x761c472 data_size 0x31(0xaf85 bytes) 2024-09-14T07:12:37.864 INFO:teuthology.orchestra.run.smithi071.stdout:3665 punch from 0x35c7fc5 to 0x35ce57a, (0x65b5 bytes) 2024-09-14T07:12:37.874 INFO:teuthology.orchestra.run.smithi071.stdout:3666 writesame 0xeaa7e96 thru 0xeaadfaa data_size 0x1(0x6115 bytes) 2024-09-14T07:12:37.874 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.874 INFO:teuthology.orchestra.run.smithi071.stdout:3669 read 0x187eb2 thru 0x18f576 (0x76c5 bytes) 2024-09-14T07:12:37.874 INFO:teuthology.orchestra.run.smithi071.stdout:3670 read 0xc1de1c7 thru 0xc1e9add (0xb917 bytes) 2024-09-14T07:12:37.874 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.874 INFO:teuthology.orchestra.run.smithi071.stdout:3672 read 0x4d15573 thru 0x4d2534f (0xfddd bytes) 2024-09-14T07:12:37.875 INFO:teuthology.orchestra.run.smithi071.stdout:3674 read 0x3fff4a5 thru 0x4001f0f (0x2a6b bytes) 2024-09-14T07:12:37.875 INFO:teuthology.orchestra.run.smithi071.stdout:3675 punch from 0xad3779c to 0xad3cb9f, (0x5403 bytes) 2024-09-14T07:12:37.875 INFO:teuthology.orchestra.run.smithi071.stdout:3677 write 0x427554 thru 0x43121a (0x9cc7 bytes) 2024-09-14T07:12:37.875 INFO:teuthology.orchestra.run.smithi071.stdout:3678 read 0x1a00f5c thru 0x1a10348 (0xf3ed bytes) 2024-09-14T07:12:37.875 INFO:teuthology.orchestra.run.smithi071.stdout:3680 writesame 0xe7b84a5 thru 0xe7c3b40 data_size 0x74(0xb69c bytes) 2024-09-14T07:12:37.879 INFO:teuthology.orchestra.run.smithi071.stdout:3681 write 0x981828b thru 0x9819b05 (0x187b bytes) 2024-09-14T07:12:37.881 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.885 INFO:teuthology.orchestra.run.smithi071.stdout:3683 trunc from 0xeaadfab to 0xbbeb928 2024-09-14T07:12:37.894 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.894 INFO:teuthology.orchestra.run.smithi071.stdout:3685 write 0x3dd250d thru 0x3dd96d8 (0x71cc bytes) 2024-09-14T07:12:37.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:12:37.900 INFO:teuthology.orchestra.run.smithi071.stdout:3686 trunc from 0xbbeb928 to 0x993412d 2024-09-14T07:12:37.906 INFO:teuthology.orchestra.run.smithi071.stdout:3687 write 0x549ed53 thru 0x54a0c53 (0x1f01 bytes) 2024-09-14T07:12:37.913 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:37.912+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:37.916 INFO:teuthology.orchestra.run.smithi071.stdout:3689 write 0xb1360c2 thru 0xb13d8a6 (0x77e5 bytes) 2024-09-14T07:12:37.920 INFO:teuthology.orchestra.run.smithi071.stdout:3690 read 0xa78d033 thru 0xa792ec8 (0x5e96 bytes) 2024-09-14T07:12:37.927 INFO:teuthology.orchestra.run.smithi071.stdout:3691 writesame 0xcc36645 thru 0xcc374f3 data_size 0x7(0xeaf bytes) 2024-09-14T07:12:37.927 INFO:teuthology.orchestra.run.smithi071.stdout:3693 write 0xa2f1df7 thru 0xa2fe07c (0xc286 bytes) 2024-09-14T07:12:37.930 INFO:teuthology.orchestra.run.smithi071.stdout:3695 write 0xc99a54a thru 0xc99c711 (0x21c8 bytes) 2024-09-14T07:12:37.933 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.939 INFO:teuthology.orchestra.run.smithi071.stdout:3697 write 0xe062ee5 thru 0xe068bc9 (0x5ce5 bytes) 2024-09-14T07:12:37.941 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:37.941 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:37.942 INFO:teuthology.orchestra.run.smithi071.stdout:3698 write 0x8d312be thru 0x8d3ca89 (0xb7cc bytes) 2024-09-14T07:12:37.944 INFO:teuthology.orchestra.run.smithi071.stdout:3700 writesame 0x310012f thru 0x310a164 data_size 0x1(0xa036 bytes) 2024-09-14T07:12:37.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:37.965 INFO:teuthology.orchestra.run.smithi071.stdout:3701 write 0x81639ad thru 0x816c789 (0x8ddd bytes) 2024-09-14T07:12:37.967 INFO:teuthology.orchestra.run.smithi071.stdout:3703 writesame 0x2afd903 thru 0x2b08347 data_size 0xd(0xaa45 bytes) 2024-09-14T07:12:37.971 INFO:teuthology.orchestra.run.smithi071.stdout:3704 punch from 0x1209f33 to 0x12146c0, (0xa78d bytes) 2024-09-14T07:12:37.971 INFO:teuthology.orchestra.run.smithi071.stdout:3706 write 0x477b9ad thru 0x477c282 (0x8d6 bytes) 2024-09-14T07:12:37.975 INFO:teuthology.orchestra.run.smithi071.stdout:3707 writesame 0x62fbb2a thru 0x63067a2 data_size 0x1(0xac79 bytes) 2024-09-14T07:12:37.993 INFO:teuthology.orchestra.run.smithi071.stdout:3709 read 0x21126b0 thru 0x212245d (0xfdae bytes) 2024-09-14T07:12:37.993 INFO:teuthology.orchestra.run.smithi071.stdout:3710 write 0x41566ca thru 0x4160ecc (0xa803 bytes) 2024-09-14T07:12:37.996 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:37.996 INFO:teuthology.orchestra.run.smithi071.stdout:3712 write 0xd62a6fb thru 0xd634228 (0x9b2e bytes) 2024-09-14T07:12:38.011 INFO:teuthology.orchestra.run.smithi071.stdout:3713 trunc from 0xe068bca to 0x35c4113 2024-09-14T07:12:38.014 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:38.013+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:38.037 INFO:teuthology.orchestra.run.smithi071.stdout:3714 write 0x6f84f1c thru 0x6f85e6c (0xf51 bytes) 2024-09-14T07:12:38.039 INFO:teuthology.orchestra.run.smithi071.stdout:3715 read 0x41506a9 thru 0x4155aca (0x5422 bytes) 2024-09-14T07:12:38.045 INFO:teuthology.orchestra.run.smithi071.stdout:3719 write 0x8a7c9dd thru 0x8a7ec3f (0x2263 bytes) 2024-09-14T07:12:38.054 INFO:teuthology.orchestra.run.smithi071.stdout:3720 trunc from 0x8a7ec40 to 0xd4ccdb4 2024-09-14T07:12:38.058 INFO:teuthology.orchestra.run.smithi071.stdout:3721 writesame 0x3695691 thru 0x36a441d data_size 0x9(0xed8d bytes) 2024-09-14T07:12:38.061 INFO:teuthology.orchestra.run.smithi071.stdout:3722 punch from 0x771e2e0 to 0x7720713, (0x2433 bytes) 2024-09-14T07:12:38.071 INFO:teuthology.orchestra.run.smithi071.stdout:3724 trunc from 0xd4ccdb4 to 0x5890589 2024-09-14T07:12:38.079 INFO:teuthology.orchestra.run.smithi071.stdout:3726 write 0x17a5306 thru 0x17a969f (0x439a bytes) 2024-09-14T07:12:38.082 INFO:teuthology.orchestra.run.smithi071.stdout:3727 read 0x808b84 thru 0x810c36 (0x80b3 bytes) 2024-09-14T07:12:38.083 INFO:teuthology.orchestra.run.smithi071.stdout:3728 read 0x5172acb thru 0x517868f (0x5bc5 bytes) 2024-09-14T07:12:38.083 INFO:teuthology.orchestra.run.smithi071.stdout:3730 punch from 0xe2573d to 0xe333f9, (0xdcbc bytes) 2024-09-14T07:12:38.083 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.083 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.091 INFO:teuthology.orchestra.run.smithi071.stdout:3733 writesame 0x77d5d1f thru 0x77d76f9 data_size 0x1(0x19db bytes) 2024-09-14T07:12:38.099 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:38.099 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:38.103 INFO:teuthology.orchestra.run.smithi071.stdout:3735 write 0xc6e52f8 thru 0xc6f21dd (0xcee6 bytes) 2024-09-14T07:12:38.107 INFO:teuthology.orchestra.run.smithi071.stdout:3736 writesame 0x4933ac3 thru 0x494116e data_size 0x16(0xd6ac bytes) 2024-09-14T07:12:38.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:38.130 INFO:teuthology.orchestra.run.smithi071.stdout:3737 trunc from 0xc6f21de to 0xceb35f 2024-09-14T07:12:38.130 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:38.129+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:38.144 INFO:teuthology.orchestra.run.smithi071.stdout:3738 read 0xb7f9a9 thru 0xb84097 (0x46ef bytes) 2024-09-14T07:12:38.145 INFO:teuthology.orchestra.run.smithi071.stdout:3739 read 0x4a63dd thru 0x4b4c58 (0xe87c bytes) 2024-09-14T07:12:38.163 INFO:teuthology.orchestra.run.smithi071.stdout:3740 writesame 0x916f566 thru 0x9175d51 data_size 0x12(0x67ec bytes) 2024-09-14T07:12:38.163 INFO:teuthology.orchestra.run.smithi071.stdout:3742 write 0xe42fe8 thru 0xe47467 (0x4480 bytes) 2024-09-14T07:12:38.167 INFO:teuthology.orchestra.run.smithi071.stdout:3743 trunc from 0x9175d52 to 0x6d843de 2024-09-14T07:12:38.172 INFO:teuthology.orchestra.run.smithi071.stdout:3744 read 0x52269d7 thru 0x522cd81 (0x63ab bytes) 2024-09-14T07:12:38.182 INFO:teuthology.orchestra.run.smithi071.stdout:3746 write 0xaa06c81 thru 0xaa16b26 (0xfea6 bytes) 2024-09-14T07:12:38.189 INFO:teuthology.orchestra.run.smithi071.stdout:3747 read 0x7b4ad6f thru 0x7b55726 (0xa9b8 bytes) 2024-09-14T07:12:38.189 INFO:teuthology.orchestra.run.smithi071.stdout:3749 punch from 0x287ad5f to 0x287bfa1, (0x1242 bytes) 2024-09-14T07:12:38.189 INFO:teuthology.orchestra.run.smithi071.stdout:3750 writesame 0xa63f8ab thru 0xa64f4cf data_size 0x1(0xfc25 bytes) 2024-09-14T07:12:38.214 INFO:teuthology.orchestra.run.smithi071.stdout:3751 write 0x399ebd2 thru 0x39adbe6 (0xf015 bytes) 2024-09-14T07:12:38.215 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:38.215+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:38.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:38.227 INFO:teuthology.orchestra.run.smithi071.stdout:3752 write 0xd395dcb thru 0xd3a4d4d (0xef83 bytes) 2024-09-14T07:12:38.231 INFO:teuthology.orchestra.run.smithi071.stdout:3755 trunc from 0xd3a4d4e to 0xd39d551 2024-09-14T07:12:38.239 INFO:teuthology.orchestra.run.smithi071.stdout:3756 punch from 0x437ebd4 to 0x4381f1f, (0x334b bytes) 2024-09-14T07:12:38.239 INFO:teuthology.orchestra.run.smithi071.stdout:3757 read 0x4103cb5 thru 0x410ba31 (0x7d7d bytes) 2024-09-14T07:12:38.239 INFO:teuthology.orchestra.run.smithi071.stdout:3762 writesame 0x8f773ab thru 0x8f8079a data_size 0x48(0x93f0 bytes) 2024-09-14T07:12:38.242 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.256 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:38.256 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:38.257 INFO:teuthology.orchestra.run.smithi071.stdout:3764 trunc from 0xd39d551 to 0x1ae6387 2024-09-14T07:12:38.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:38.270 INFO:teuthology.orchestra.run.smithi071.stdout:3765 read 0x2a1f7a thru 0x2ae95a (0xc9e1 bytes) 2024-09-14T07:12:38.270 INFO:teuthology.orchestra.run.smithi071.stdout:3767 read 0xab239e thru 0xac0a07 (0xe66a bytes) 2024-09-14T07:12:38.271 INFO:teuthology.orchestra.run.smithi071.stdout:3768 read 0x14cc9f6 thru 0x14ce24e (0x1859 bytes) 2024-09-14T07:12:38.271 INFO:teuthology.orchestra.run.smithi071.stdout:3769 punch from 0xcbfcac to 0xccd7ee, (0xdb42 bytes) 2024-09-14T07:12:38.271 INFO:teuthology.orchestra.run.smithi071.stdout:3771 punch from 0x2b768e to 0x2c3e7b, (0xc7ed bytes) 2024-09-14T07:12:38.271 INFO:teuthology.orchestra.run.smithi071.stdout:3772 read 0x111fa8 thru 0x11db00 (0xbb59 bytes) 2024-09-14T07:12:38.271 INFO:teuthology.orchestra.run.smithi071.stdout:3774 read 0x1935c0c thru 0x193ed04 (0x90f9 bytes) 2024-09-14T07:12:38.271 INFO:teuthology.orchestra.run.smithi071.stdout:3775 writesame 0x14c960f thru 0x14d3d20 data_size 0x5e(0xa712 bytes) 2024-09-14T07:12:38.274 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.274 INFO:teuthology.orchestra.run.smithi071.stdout:3779 read 0x83800a thru 0x840371 (0x8368 bytes) 2024-09-14T07:12:38.288 INFO:teuthology.orchestra.run.smithi071.stdout:3780 write 0x8c893a6 thru 0x8c8a57e (0x11d9 bytes) 2024-09-14T07:12:38.298 INFO:teuthology.orchestra.run.smithi071.stdout:3781 writesame 0xaa91e61 thru 0xaa95b8a data_size 0x1(0x3d2a bytes) 2024-09-14T07:12:38.298 INFO:teuthology.orchestra.run.smithi071.stdout:3782 punch from 0x23d80d1 to 0x23e5e55, (0xdd84 bytes) 2024-09-14T07:12:38.306 INFO:teuthology.orchestra.run.smithi071.stdout:3784 trunc from 0xaa95b8b to 0x39e65df 2024-09-14T07:12:38.317 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:38.316+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:38.317 INFO:teuthology.orchestra.run.smithi071.stdout:3787 read 0x2acde06 thru 0x2ad43c9 (0x65c4 bytes) 2024-09-14T07:12:38.325 INFO:teuthology.orchestra.run.smithi071.stdout:3789 trunc from 0x39e65df to 0xa967979 2024-09-14T07:12:38.331 INFO:teuthology.orchestra.run.smithi071.stdout:3790 read 0x61b0e42 thru 0x61bba83 (0xac42 bytes) 2024-09-14T07:12:38.331 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.331 INFO:teuthology.orchestra.run.smithi071.stdout:3792 read 0x71d639d thru 0x71db13b (0x4d9f bytes) 2024-09-14T07:12:38.331 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.331 INFO:teuthology.orchestra.run.smithi071.stdout:3794 read 0x132c4d3 thru 0x133af70 (0xea9e bytes) 2024-09-14T07:12:38.331 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.335 INFO:teuthology.orchestra.run.smithi071.stdout:3796 trunc from 0xa967979 to 0x6da933f 2024-09-14T07:12:38.352 INFO:teuthology.orchestra.run.smithi071.stdout:3797 writesame 0xba80d9c thru 0xba8e095 data_size 0x37(0xd2fa bytes) 2024-09-14T07:12:38.356 INFO:teuthology.orchestra.run.smithi071.stdout:3798 write 0xbae74be thru 0xbaeac64 (0x37a7 bytes) 2024-09-14T07:12:38.360 INFO:teuthology.orchestra.run.smithi071.stdout:3800 read 0xacd3532 thru 0xacdbe88 (0x8957 bytes) 2024-09-14T07:12:38.360 INFO:teuthology.orchestra.run.smithi071.stdout:3801 write 0x7da797 thru 0x7e236a (0x7bd4 bytes) 2024-09-14T07:12:38.361 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.361 INFO:teuthology.orchestra.run.smithi071.stdout:3803 write 0x9f4af48 thru 0x9f56912 (0xb9cb bytes) 2024-09-14T07:12:38.362 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:38.362 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:38.364 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.364 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.364 INFO:teuthology.orchestra.run.smithi071.stdout:3807 writesame 0x7fdc47c thru 0x7fe932b data_size 0x8(0xceb0 bytes) 2024-09-14T07:12:38.375 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:38.375 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:38.375 INFO:teuthology.orchestra.run.smithi071.stdout:3808 write 0xd6dc7a8 thru 0xd6deb8f (0x23e8 bytes) 2024-09-14T07:12:38.378 INFO:teuthology.orchestra.run.smithi071.stdout:3809 write 0x34099b5 thru 0x34162d5 (0xc921 bytes) 2024-09-14T07:12:38.381 INFO:teuthology.orchestra.run.smithi071.stdout:3810 punch from 0x6d2205e to 0x6d2f437, (0xd3d9 bytes) 2024-09-14T07:12:38.381 INFO:teuthology.orchestra.run.smithi071.stdout:3811 punch from 0xc30b63e to 0xc30bfec, (0x9ae bytes) 2024-09-14T07:12:38.381 INFO:teuthology.orchestra.run.smithi071.stdout:3813 write 0x58d5c67 thru 0x58e57a7 (0xfb41 bytes) 2024-09-14T07:12:38.382 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:38.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:38.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:38.385 INFO:teuthology.orchestra.run.smithi071.stdout:3816 punch from 0x3a55193 to 0x3a63f98, (0xee05 bytes) 2024-09-14T07:12:38.385 INFO:teuthology.orchestra.run.smithi071.stdout:3818 punch from 0x72877f6 to 0x728ad77, (0x3581 bytes) 2024-09-14T07:12:38.385 INFO:teuthology.orchestra.run.smithi071.stdout:3820 write 0x59413f9 thru 0x594d6b9 (0xc2c1 bytes) 2024-09-14T07:12:38.386 INFO:teuthology.orchestra.run.smithi071.stdout:3822 read 0x28be1f0 thru 0x28c78d3 (0x96e4 bytes) 2024-09-14T07:12:38.393 INFO:teuthology.orchestra.run.smithi071.stdout:3823 write 0xedbc816 thru 0xedc9f37 (0xd722 bytes) 2024-09-14T07:12:38.396 INFO:teuthology.orchestra.run.smithi071.stdout:3824 write 0x13e23e4 thru 0x13eb030 (0x8c4d bytes) 2024-09-14T07:12:38.398 INFO:teuthology.orchestra.run.smithi071.stdout:3826 read 0x3c93756 thru 0x3c93cee (0x599 bytes) 2024-09-14T07:12:38.398 INFO:teuthology.orchestra.run.smithi071.stdout:3827 write 0x3e9a8a5 thru 0x3eaa4be (0xfc1a bytes) 2024-09-14T07:12:38.399 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:38.399 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:38.414 INFO:teuthology.orchestra.run.smithi071.stdout:3829 trunc from 0xedc9f38 to 0x47fcb41 2024-09-14T07:12:38.417 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:38.416+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:38.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:38.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:38.424 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.424 INFO:teuthology.orchestra.run.smithi071.stdout:3831 read 0x24d3d10 thru 0x24d969c (0x598d bytes) 2024-09-14T07:12:38.430 INFO:teuthology.orchestra.run.smithi071.stdout:3832 write 0x5ebc1e2 thru 0x5eca7ee (0xe60d bytes) 2024-09-14T07:12:38.434 INFO:teuthology.orchestra.run.smithi071.stdout:3833 read 0x308841a thru 0x309704e (0xec35 bytes) 2024-09-14T07:12:38.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:38.436 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.436 INFO:teuthology.orchestra.run.smithi071.stdout:3836 read 0xdfbb32 thru 0xe07657 (0xbb26 bytes) 2024-09-14T07:12:38.436 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:38.437 INFO:teuthology.orchestra.run.smithi071.stdout:3838 writesame 0x501b50c thru 0x5024815 data_size 0x3b(0x930a bytes) 2024-09-14T07:12:38.453 INFO:teuthology.orchestra.run.smithi071.stdout:3841 writesame 0xaf71a64 thru 0xaf80c1a data_size 0x1(0xf1b7 bytes) 2024-09-14T07:12:38.454 INFO:teuthology.orchestra.run.smithi071.stdout:3843 punch from 0x64a6f2b to 0x64ae279, (0x734e bytes) 2024-09-14T07:12:38.454 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.454 INFO:teuthology.orchestra.run.smithi071.stdout:3845 writesame 0x35561fb thru 0x355aaee data_size 0x5c(0x48f4 bytes) 2024-09-14T07:12:38.455 INFO:teuthology.orchestra.run.smithi071.stdout:3847 write 0x8a3d929 thru 0x8a3dcfc (0x3d4 bytes) 2024-09-14T07:12:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:38.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:38.465 INFO:teuthology.orchestra.run.smithi071.stdout:3848 writesame 0xcef6f8f thru 0xcef8a51 data_size 0x11(0x1ac3 bytes) 2024-09-14T07:12:38.465 INFO:teuthology.orchestra.run.smithi071.stdout:3850 write 0x6594ce5 thru 0x659a327 (0x5643 bytes) 2024-09-14T07:12:38.469 INFO:teuthology.orchestra.run.smithi071.stdout:3851 write 0xc988c67 thru 0xc98fd84 (0x711e bytes) 2024-09-14T07:12:38.473 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.476 INFO:teuthology.orchestra.run.smithi071.stdout:3853 trunc from 0xcef8a52 to 0xab86581 2024-09-14T07:12:38.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:38.484 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:38.485 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:38.485 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.485 INFO:teuthology.orchestra.run.smithi071.stdout:3855 write 0x843520c thru 0x8435aa8 (0x89d bytes) 2024-09-14T07:12:38.490 INFO:teuthology.orchestra.run.smithi071.stdout:3856 trunc from 0xab86581 to 0xd99a68b 2024-09-14T07:12:38.492 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:38.493 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:38.494 INFO:teuthology.orchestra.run.smithi071.stdout:3857 write 0x38ece thru 0x3e763 (0x5896 bytes) 2024-09-14T07:12:38.496 INFO:teuthology.orchestra.run.smithi071.stdout:3860 write 0x8e87a1c thru 0x8e96e3f (0xf424 bytes) 2024-09-14T07:12:38.498 INFO:teuthology.orchestra.run.smithi071.stdout:3863 read 0x4bcacb6 thru 0x4bcc652 (0x199d bytes) 2024-09-14T07:12:38.498 INFO:teuthology.orchestra.run.smithi071.stdout:3865 punch from 0xa409dc6 to 0xa4176df, (0xd919 bytes) 2024-09-14T07:12:38.498 INFO:teuthology.orchestra.run.smithi071.stdout:3866 write 0xb41a938 thru 0xb4263cf (0xba98 bytes) 2024-09-14T07:12:38.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:38.513 INFO:teuthology.orchestra.run.smithi071.stdout:3868 trunc from 0xd99a68b to 0x40e0c0f 2024-09-14T07:12:38.522 INFO:teuthology.orchestra.run.smithi071.stdout:3869 read 0x27b8d72 thru 0x27bcbfd (0x3e8c bytes) 2024-09-14T07:12:38.523 INFO:teuthology.orchestra.run.smithi071.stdout:3870 trunc from 0x40e0c0f to 0x46478f3 2024-09-14T07:12:38.528 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.528 INFO:teuthology.orchestra.run.smithi071.stdout:3875 read 0x17bf59a thru 0x17c9f1d (0xa984 bytes) 2024-09-14T07:12:38.529 INFO:teuthology.orchestra.run.smithi071.stdout:3877 read 0x3f2ae2c thru 0x3f33aa1 (0x8c76 bytes) 2024-09-14T07:12:38.529 INFO:teuthology.orchestra.run.smithi071.stdout:3878 read 0x1d987b9 thru 0x1da538d (0xcbd5 bytes) 2024-09-14T07:12:38.529 INFO:teuthology.orchestra.run.smithi071.stdout:3880 write 0x302d4a3 thru 0x3036a5b (0x95b9 bytes) 2024-09-14T07:12:38.533 INFO:teuthology.orchestra.run.smithi071.stdout:3881 trunc from 0x46478f3 to 0x6684960 2024-09-14T07:12:38.539 INFO:teuthology.orchestra.run.smithi071.stdout:3882 write 0x54aa798 thru 0x54b5d3b (0xb5a4 bytes) 2024-09-14T07:12:38.545 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:38.545+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:38.546 INFO:teuthology.orchestra.run.smithi071.stdout:3884 write 0xd50886 thru 0xd5b6f6 (0xae71 bytes) 2024-09-14T07:12:38.547 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.547 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.559 INFO:teuthology.orchestra.run.smithi071.stdout:3890 writesame 0xbf509e0 thru 0xbf57c88 data_size 0x1(0x72a9 bytes) 2024-09-14T07:12:38.559 INFO:teuthology.orchestra.run.smithi071.stdout:3893 write 0x624048e thru 0x624c0ca (0xbc3d bytes) 2024-09-14T07:12:38.566 INFO:teuthology.orchestra.run.smithi071.stdout:3896 read 0x321143e thru 0x3215ec1 (0x4a84 bytes) 2024-09-14T07:12:38.571 INFO:teuthology.orchestra.run.smithi071.stdout:3897 trunc from 0xbf57c89 to 0x80c58ea 2024-09-14T07:12:38.575 INFO:teuthology.orchestra.run.smithi071.stdout:3898 write 0x35a5a27 thru 0x35a91c2 (0x379c bytes) 2024-09-14T07:12:38.577 INFO:teuthology.orchestra.run.smithi071.stdout:3899 writesame 0x36a3fa4 thru 0x36a8a39 data_size 0x1(0x4a96 bytes) 2024-09-14T07:12:38.588 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.588 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.589 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.589 INFO:teuthology.orchestra.run.smithi071.stdout:3903 punch from 0x4aae59e to 0x4abd041, (0xeaa3 bytes) 2024-09-14T07:12:38.593 INFO:teuthology.orchestra.run.smithi071.stdout:3904 trunc from 0x80c58ea to 0x3da842b 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20262 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751722354000002, 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055198311999999999, 2024-09-14T07:12:38.613 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20262 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858247+0000", 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858249+0000", 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9860000000000001e-06 2024-09-14T07:12:38.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858256+0000", 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7460000000000003e-06 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858261+0000", 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6840000000000001e-06 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913197+0000", 2024-09-14T07:12:38.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.054935171999999997 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913239+0000", 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2460999999999999e-05 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913445+0000", 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205894 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20264 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1019904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751694267000001, 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055428349000000002, 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20264 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858275+0000", 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:38.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858282+0000", 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5640000000000002e-06 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858289+0000", 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5839999999999997e-06 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858292+0000", 2024-09-14T07:12:38.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.999e-06 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913465+0000", 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055172959000000001 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913524+0000", 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8489000000000002e-05 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913703+0000", 2024-09-14T07:12:38.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000179354 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20266 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 565248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751655174, 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055643262999999998, 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20266 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858314+0000", 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7800000000000002e-07 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858316+0000", 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5570000000000001e-06 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858319+0000", 2024-09-14T07:12:38.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5990000000000002e-06 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858322+0000", 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913743+0000", 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055421103999999999 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913797+0000", 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3492000000000002e-05 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913957+0000", 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000160457 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20267 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 622592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:38.626 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751643805, 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055883545, 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20267 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:38.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858325+0000", 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9999999999999999e-07 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858326+0000", 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3699999999999999e-07 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858330+0000", 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2969999999999999e-06 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858332+0000", 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6070000000000002e-06 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.913986+0000", 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055653310999999997 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914028+0000", 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2678e-05 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914209+0000", 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018041500000000001 2024-09-14T07:12:38.630 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20270 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 679936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751632076, 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056156692000000001, 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20270 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858337+0000", 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.39e-07 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858339+0000", 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.697e-06 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858345+0000", 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6690000000000003e-06 2024-09-14T07:12:38.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858349+0000", 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4089999999999996e-06 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914250+0000", 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.055901301 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914304+0000", 2024-09-14T07:12:38.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3331999999999997e-05 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914494+0000", 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018994500000000001 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20272 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 737280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751615927, 2024-09-14T07:12:38.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056423736000000002, 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20272 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:38.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858353+0000", 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858354+0000", 2024-09-14T07:12:38.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1039999999999999e-06 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858359+0000", 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.899e-06 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858363+0000", 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2409999999999997e-06 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914526+0000", 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056163006000000001 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914568+0000", 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1937000000000002e-05 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914777+0000", 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020833399999999999 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20277 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.7515997, 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056720242999999997, 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20277 2024-09-14T07:12:38.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858369+0000", 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858370+0000", 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7e-07 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858372+0000", 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0229999999999999e-06 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858378+0000", 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9869999999999996e-06 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858383+0000", 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3489999999999999e-06 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914816+0000", 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056432942999999999 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.914877+0000", 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0627000000000001e-05 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915089+0000", 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021294400000000001 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20280 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 851968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.645 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:38.645 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751579757000002, 2024-09-14T07:12:38.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056953472999999998, 2024-09-14T07:12:38.645 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20280 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858389+0000", 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858390+0000", 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:38.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858392+0000", 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0899999999999999e-06 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858398+0000", 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9399999999999999e-06 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858403+0000", 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.074e-06 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915119+0000", 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056716338999999998 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915164+0000", 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4642999999999999e-05 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915343+0000", 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017900199999999999 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20281 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 569344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751560092999998, 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057219575000000002, 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20281 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858409+0000", 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000003e-07 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858411+0000", 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9199999999999998e-06 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858417+0000", 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7729999999999996e-06 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858422+0000", 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7180000000000004e-06 2024-09-14T07:12:38.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915373+0000", 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.056951193999999997 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915414+0000", 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1301000000000003e-05 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915628+0000", 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214095 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20282 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 909312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751541211999999, 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057564303999999997, 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20282 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858428+0000", 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6899999999999998e-07 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858430+0000", 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858436+0000", 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7189999999999998e-06 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858440+0000", 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.651e-06 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915664+0000", 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057223759999999999 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915761+0000", 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7372000000000002e-05 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915992+0000", 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023059099999999999 2024-09-14T07:12:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20283 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 626688~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751522629, 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057833405999999997, 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20283 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858446+0000", 2024-09-14T07:12:38.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858447+0000", 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2900000000000004e-07 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858449+0000", 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0020000000000001e-06 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858454+0000", 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3809999999999998e-06 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858459+0000", 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4889999999999997e-06 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916036+0000", 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057576910000000002 2024-09-14T07:12:38.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916116+0000", 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0643999999999996e-05 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916280+0000", 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000163451 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20284 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 966656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751504268000001, 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058094858999999999, 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20284 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858465+0000", 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9999999999999998e-07 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858467+0000", 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.874e-06 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858472+0000", 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5629999999999999e-06 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858477+0000", 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7910000000000004e-06 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916311+0000", 2024-09-14T07:12:38.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.057833757999999999 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916358+0000", 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7018999999999998e-05 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916560+0000", 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201454 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20285 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 684032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751486290999999, 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058354537999999997, 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20285 2024-09-14T07:12:38.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858483+0000", 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9700000000000002e-07 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858485+0000", 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858490+0000", 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9729999999999997e-06 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858493+0000", 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6059999999999999e-06 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916588+0000", 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058094693000000003 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916673+0000", 2024-09-14T07:12:38.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4994000000000007e-05 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916837+0000", 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016414199999999999 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20286 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751470203, 2024-09-14T07:12:38.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058559422999999999, 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20286 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:38.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858499+0000", 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4099999999999999e-07 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858505+0000", 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6699999999999999e-06 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858511+0000", 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2990000000000002e-06 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858516+0000", 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0379999999999999e-06 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916866+0000", 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058349491000000003 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916919+0000", 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3811999999999999e-05 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917058+0000", 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000138672 2024-09-14T07:12:38.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20287 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 741376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751427449000001, 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058806793000000003, 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20287 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858541+0000", 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858542+0000", 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5400000000000001e-07 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858544+0000", 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.272e-06 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858550+0000", 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6980000000000003e-06 2024-09-14T07:12:38.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858553+0000", 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9450000000000002e-06 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917093+0000", 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058540433000000003 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917189+0000", 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5525000000000004e-05 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917348+0000", 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159266 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20298 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 798720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.683 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751410564, 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059061633000000002, 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20298 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858558+0000", 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858559+0000", 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7199999999999999e-07 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858560+0000", 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.641e-06 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858565+0000", 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1350000000000002e-06 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858567+0000", 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:12:38.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917378+0000", 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.058810442999999997 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917423+0000", 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4756999999999999e-05 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917620+0000", 2024-09-14T07:12:38.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000197424 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20301 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 856064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751398231, 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059306867999999999, 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20301 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:38.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858571+0000", 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858572+0000", 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.085e-06 2024-09-14T07:12:38.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858575+0000", 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9289999999999998e-06 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858578+0000", 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:12:38.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917659+0000", 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059081394000000002 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917734+0000", 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5426000000000006e-05 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917878+0000", 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014318999999999999 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20303 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 913408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751388132999999, 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059649109999999998, 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20303 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858581+0000", 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858582+0000", 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1800000000000004e-07 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858585+0000", 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.796e-06 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858588+0000", 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.044e-06 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.917920+0000", 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059332480999999999 2024-09-14T07:12:38.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918010+0000", 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9884999999999997e-05 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918230+0000", 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021977300000000001 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20305 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 970752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751378424999999, 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059866838999999998, 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20305 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858590+0000", 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858591+0000", 2024-09-14T07:12:38.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858592+0000", 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858594+0000", 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7779999999999999e-06 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858597+0000", 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3609999999999999e-06 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918253+0000", 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059656265 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918296+0000", 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2963999999999997e-05 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918457+0000", 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016128900000000001 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:20307 3.e 3:7117643f:::rbd_data.11824d7f600c.0000000000000000:f [read 1028096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 21.751369526000001, 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.060103704000000001, 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 20307 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858599+0000", 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858600+0000", 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1199999999999999e-07 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858600+0000", 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9100000000000002e-07 2024-09-14T07:12:38.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858604+0000", 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4819999999999999e-06 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.858606+0000", 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3709999999999998e-06 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918494+0000", 2024-09-14T07:12:38.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059887915999999999 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918542+0000", 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7661000000000003e-05 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.918703+0000", 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016117099999999999 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.707 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.707 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:38.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:38.710 INFO:teuthology.orchestra.run.smithi071.stdout:3905 write 0x7a42b08 thru 0x7a45ca1 (0x319a bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3906 read 0x6582128 thru 0x658d9ad (0xb886 bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3909 trunc from 0x7a45ca2 to 0x9332631 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3910 trunc from 0x9332631 to 0x84a4ce5 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3911 write 0x1a20580 thru 0x1a2b810 (0xb291 bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3913 write 0x1bd89f4 thru 0x1be5976 (0xcf83 bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3914 writesame 0xf7921e thru 0xf87ac6 data_size 0x1(0xe8a9 bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3915 write 0x12f1292 thru 0x12f2e89 (0x1bf8 bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3917 write 0x548626f thru 0x549231b (0xc0ad bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3918 writesame 0xba16f9e thru 0xba21929 data_size 0x6(0xa98c bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3919 punch from 0xb1352c6 to 0xb135d08, (0xa42 bytes) 2024-09-14T07:12:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:3920 punch from 0x351465b to 0x35177c2, (0x3167 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3921 read 0x1e7a3d7 thru 0x1e7e3d6 (0x4000 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3922 write 0xa13b160 thru 0xa13b602 (0x4a3 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3924 read 0x97edfc8 thru 0x97f97bc (0xb7f5 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3925 read 0x6acb3a2 thru 0x6ad81bc (0xce1b bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3928 writesame 0x38d607c thru 0x38de392 data_size 0x1(0x8317 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3929 write 0x9b67278 thru 0x9b7161a (0xa3a3 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3930 write 0xd80209b thru 0xd802d6d (0xcd3 bytes) 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.712 INFO:teuthology.orchestra.run.smithi071.stdout:3932 trunc from 0xd802d6e to 0x74d1d8e 2024-09-14T07:12:38.712 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:38.707+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:38.713 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.713 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:3935 read 0x50f5b1b thru 0x50fcbe5 (0x70cb bytes) 2024-09-14T07:12:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:3936 read 0x3a2218e thru 0x3a3090e (0xe781 bytes) 2024-09-14T07:12:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:3938 read 0x3a12b7d thru 0x3a131e3 (0x667 bytes) 2024-09-14T07:12:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:3941 read 0x21c0803 thru 0x21c9009 (0x8807 bytes) 2024-09-14T07:12:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:3942 read 0x5e2ba69 thru 0x5e36676 (0xac0e bytes) 2024-09-14T07:12:38.714 INFO:teuthology.orchestra.run.smithi071.stdout:3944 read 0x34c3e0 thru 0x359047 (0xcc68 bytes) 2024-09-14T07:12:38.716 INFO:teuthology.orchestra.run.smithi071.stdout:3946 trunc from 0x74d1d8e to 0x507d230 2024-09-14T07:12:38.722 INFO:teuthology.orchestra.run.smithi071.stdout:3947 read 0xd1f269 thru 0xd24153 (0x4eeb bytes) 2024-09-14T07:12:38.723 INFO:teuthology.orchestra.run.smithi071.stdout:3948 read 0x21f7fef thru 0x2205f21 (0xdf33 bytes) 2024-09-14T07:12:38.723 INFO:teuthology.orchestra.run.smithi071.stdout:3949 writesame 0x12c37b5 thru 0x12c3ca3 data_size 0x1(0x4ef bytes) 2024-09-14T07:12:38.730 INFO:teuthology.orchestra.run.smithi071.stdout:3951 trunc from 0x507d230 to 0x9dc8e39 2024-09-14T07:12:38.734 INFO:teuthology.orchestra.run.smithi071.stdout:3952 writesame 0x3d38ef3 thru 0x3d3e2d3 data_size 0x1(0x53e1 bytes) 2024-09-14T07:12:38.744 INFO:teuthology.orchestra.run.smithi071.stdout:3953 writesame 0x870b3ed thru 0x871aacc data_size 0x64(0xf6e0 bytes) 2024-09-14T07:12:38.747 INFO:teuthology.orchestra.run.smithi071.stdout:3954 punch from 0x1683287 to 0x168c26c, (0x8fe5 bytes) 2024-09-14T07:12:38.758 INFO:teuthology.orchestra.run.smithi071.stdout:3957 writesame 0xeb6a55b thru 0xeb72022 data_size 0x4(0x7ac8 bytes) 2024-09-14T07:12:38.758 INFO:teuthology.orchestra.run.smithi071.stdout:3958 read 0x5b91cea thru 0x5ba11a9 (0xf4c0 bytes) 2024-09-14T07:12:38.758 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.758 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.759 INFO:teuthology.orchestra.run.smithi071.stdout:3962 write 0xc9ccd5f thru 0xc9da9d8 (0xdc7a bytes) 2024-09-14T07:12:38.762 INFO:teuthology.orchestra.run.smithi071.stdout:3964 writesame 0xca42661 thru 0xca4b1aa data_size 0x1(0x8b4a bytes) 2024-09-14T07:12:38.775 INFO:teuthology.orchestra.run.smithi071.stdout:3968 read 0x7ba1f0c thru 0x7ba75f1 (0x56e6 bytes) 2024-09-14T07:12:38.775 INFO:teuthology.orchestra.run.smithi071.stdout:3969 read 0x3498e1 thru 0x358494 (0xebb4 bytes) 2024-09-14T07:12:38.776 INFO:teuthology.orchestra.run.smithi071.stdout:3970 read 0xcca9260 thru 0xccb4c03 (0xb9a4 bytes) 2024-09-14T07:12:38.776 INFO:teuthology.orchestra.run.smithi071.stdout:3971 write 0x844e54c thru 0x845d7f8 (0xf2ad bytes) 2024-09-14T07:12:38.777 INFO:teuthology.orchestra.run.smithi071.stdout:3972 writesame 0x714e708 thru 0x7157d98 data_size 0xd(0x9691 bytes) 2024-09-14T07:12:38.781 INFO:teuthology.orchestra.run.smithi071.stdout:3975 write 0x7b5e728 thru 0x7b662f8 (0x7bd1 bytes) 2024-09-14T07:12:38.784 INFO:teuthology.orchestra.run.smithi071.stdout:3976 read 0x12a98f7 thru 0x12b188b (0x7f95 bytes) 2024-09-14T07:12:38.785 INFO:teuthology.orchestra.run.smithi071.stdout:3977 read 0x475ada1 thru 0x4765409 (0xa669 bytes) 2024-09-14T07:12:38.785 INFO:teuthology.orchestra.run.smithi071.stdout:3978 read 0x1febc3c thru 0x1fed350 (0x1715 bytes) 2024-09-14T07:12:38.785 INFO:teuthology.orchestra.run.smithi071.stdout:3979 write 0xaf5947e thru 0xaf637d3 (0xa356 bytes) 2024-09-14T07:12:38.791 INFO:teuthology.orchestra.run.smithi071.stdout:3980 trunc from 0xeb72023 to 0xc01959b 2024-09-14T07:12:38.801 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:38.801 INFO:teuthology.orchestra.run.smithi071.stdout:3982 punch from 0x5b8f0b8 to 0x5b975bd, (0x8505 bytes) 2024-09-14T07:12:38.801 INFO:teuthology.orchestra.run.smithi071.stdout:3984 write 0xa2a05ef thru 0xa2abcbc (0xb6ce bytes) 2024-09-14T07:12:38.804 INFO:teuthology.orchestra.run.smithi071.stdout:3985 read 0xaafb419 thru 0xaafc065 (0xc4d bytes) 2024-09-14T07:12:38.809 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:38.808+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:38.812 INFO:teuthology.orchestra.run.smithi071.stdout:3986 writesame 0xd90020b thru 0xd902121 data_size 0x15(0x1f17 bytes) 2024-09-14T07:12:38.812 INFO:teuthology.orchestra.run.smithi071.stdout:3987 read 0xc673740 thru 0xc6773b0 (0x3c71 bytes) 2024-09-14T07:12:38.812 INFO:teuthology.orchestra.run.smithi071.stdout:3988 read 0x21b0a86 thru 0x21b5b7e (0x50f9 bytes) 2024-09-14T07:12:38.816 INFO:teuthology.orchestra.run.smithi071.stdout:3989 trunc from 0xd902122 to 0xac9cc18 2024-09-14T07:12:38.824 INFO:teuthology.orchestra.run.smithi071.stdout:3990 trunc from 0xac9cc18 to 0xd08c02b 2024-09-14T07:12:38.843 INFO:teuthology.orchestra.run.smithi071.stdout:3991 trunc from 0xd08c02b to 0x225f0c7 2024-09-14T07:12:38.854 INFO:teuthology.orchestra.run.smithi071.stdout:3995 trunc from 0x225f0c7 to 0x27b1118 2024-09-14T07:12:38.859 INFO:teuthology.orchestra.run.smithi071.stdout:3997 punch from 0x28561a to 0x2872b2, (0x1c98 bytes) 2024-09-14T07:12:38.859 INFO:teuthology.orchestra.run.smithi071.stdout:4001 write 0x12e9bb2 thru 0x12f67ea (0xcc39 bytes) 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:69596 3.10 3:0c3f7c45:::rbd_data.11828c78e1fb.0000000000000004:head [write 1530802~25678 in=25678b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:38.859558+0000", 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.0013877130000000001, 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014102229999999999, 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.862 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "waiting for sub ops", 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 69596 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859558+0000", 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859558+0000", 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859559+0000", 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.579e-06 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859581+0000", 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1868000000000001e-05 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859598+0000", 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7133999999999999e-05 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859608+0000", 2024-09-14T07:12:38.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4040000000000001e-06 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859665+0000", 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7210999999999998e-05 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859748+0000", 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2960000000000005e-05 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.859873+0000", 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000125456 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860648+0000", 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077436200000000001 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(client.4482.0:69596 3.10 e63/23 ondisk, result = 0)", 2024-09-14T07:12:38.867 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:38.860917+0000", 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.8038000000000002e-05, 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3862000000000004e-05, 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860917+0000", 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860917+0000", 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860918+0000", 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7499999999999998e-07 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860925+0000", 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2480000000000001e-06 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860934+0000", 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0019999999999995e-06 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860938+0000", 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.561e-06 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860971+0000", 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.235e-05 2024-09-14T07:12:38.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:38.860976+0000", 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1120000000000004e-06 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:38.871 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-14T07:12:38.872 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 2 2024-09-14T07:12:38.872 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:38.872 INFO:teuthology.orchestra.run.smithi071.stdout:4002 clone 27 order 19 su 4096 sc 4 2024-09-14T07:12:38.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:38.880 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:38.880 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:38.880 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T07:12:38.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T07:12:38.890 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:12:38.948 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:38.947+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:38.978 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone26 from 0x27b1118 (overlap 0xa570e) to 0x422d2 2024-09-14T07:12:38.981 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:38.982 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:38.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:39.010 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:39.009+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:39.090 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 18.241570853999999, 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:12:39.100 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:39.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:12:39.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.107 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63707 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 155648~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813271+0000", 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2851110929999998, 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077804669000000007, 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63707 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.108 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813271+0000", 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813271+0000", 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813271+0000", 2024-09-14T07:12:39.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813272+0000", 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9800000000000002e-07 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813276+0000", 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.715e-06 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813278+0000", 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-06 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.890775+0000", 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077496626999999998 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.890851+0000", 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6088999999999996e-05 2024-09-14T07:12:39.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891075+0000", 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022440399999999999 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.285100683, 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:12:39.112 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:12:39.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:12:39.116 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2850903630000001, 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.117 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:39.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:12:39.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2850713869999999, 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.122 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:12:39.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:12:39.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.126 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2850599620000001, 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:12:39.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:39.131 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2850484660000001, 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:12:39.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2850374169999998, 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:12:39.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2850271019999999, 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.141 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:12:39.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:12:39.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2849878490000002, 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.145 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:12:39.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2790928990000001, 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:39.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2790821330000002, 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.279071874, 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:12:39.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:12:39.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2790611680000001, 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2790474010000001, 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2790369309999998, 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.173 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:12:39.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2730817719999998, 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.178 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:12:39.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:12:39.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2730714000000001, 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:12:39.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.2730604730000001, 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:12:39.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:12:39.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:12:39.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.273050918, 2024-09-14T07:12:39.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:39.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.197 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.197 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:39.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:39.199 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:39.197+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:39.199 INFO:teuthology.orchestra.run.smithi071.stdout:4003 read 0x87b1f3 thru 0x884e47 (0x9c55 bytes) 2024-09-14T07:12:39.200 INFO:teuthology.orchestra.run.smithi071.stdout:4004 writesame 0x230bda0 thru 0x2310ecc data_size 0x3(0x512d bytes) 2024-09-14T07:12:39.211 INFO:teuthology.orchestra.run.smithi071.stdout:4005 write 0x199e77b thru 0x19a47be (0x6044 bytes) 2024-09-14T07:12:39.252 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:12:39.252 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:39.252 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 64, 2024-09-14T07:12:39.252 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "589dc63d-1bfc-48bf-bb57-35804a598e44", 2024-09-14T07:12:39.252 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-09-14T07:11:21.848766+0000", 2024-09-14T07:12:39.252 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-09-14T07:12:38.886397+0000", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "last_up_change": "2024-09-14T07:12:02.678229+0000", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "last_in_change": "2024-09-14T07:11:24.880196+0000", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_num": 5801984, 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_set": [ 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "noscrub", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "pglog_hardlimit", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "purged_snapdirs", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_deletes", 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "sortbitwise" 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_version": 5, 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T07:12:39.253 INFO:teuthology.orchestra.run.smithi071.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_snapshot": "", 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_max": 3, 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "max_osd": 8, 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "require_min_compat_client": "luminous", 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "min_compat_client": "luminous", 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "require_osd_release": "squid", 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_crimson": false, 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "pools": [ 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 1, 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": ".mgr", 2024-09-14T07:12:39.254 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-09-14T07:11:36.356620+0000", 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "is_stretch_pool": false, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-09-14T07:12:39.255 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 1, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 1, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 1, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 1, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 1, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.256 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "18", 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-09-14T07:12:39.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-09-14T07:12:39.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-09-14T07:12:39.259 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "options": { 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_max": 32, 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_min": 1 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": {} 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-09-14T07:12:39.260 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 6.9000000953674316, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 6.9000000953674316, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.28999999165534973, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 2, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 2, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 0.7844390869140625, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 0.77999997138977051 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 2, 2024-09-14T07:12:39.261 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "rbd", 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-09-14T07:11:40.724021+0000", 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 8193, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "is_stretch_pool": false, 2024-09-14T07:12:39.262 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 8, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 8, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 8, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 8, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 8, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-09-14T07:12:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "22", 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 2, 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 22, 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-09-14T07:12:39.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-09-14T07:12:39.265 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-09-14T07:12:39.266 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd": {} 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 3.4900000095367432, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 3.4900000095367432, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.86000001430511475, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 3, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 3, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 0.7844390869140625, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 0.77999997138977051 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 3, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "pool_client.0", 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-09-14T07:11:50.672481+0000", 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 8193, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T07:12:39.268 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "is_stretch_pool": false, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 32, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 32, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 32, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 32, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 32, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-09-14T07:12:39.269 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "64", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 29, 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 64, 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-09-14T07:12:39.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-09-14T07:12:39.271 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-09-14T07:12:39.272 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd": {} 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.d), read balance score may not be reliable", 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 0, 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 0 2024-09-14T07:12:39.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "osds": [ 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 0, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "baa123cb-89ef-45b4-8952-ad69f57110ad", 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.274 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 50, 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6818", 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6819", 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.275 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6821", 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6823", 2024-09-14T07:12:39.276 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6829", 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6831", 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6825", 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.278 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6827", 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2889617493 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6819/2889617493", 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6823/2889617493", 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6831/2889617493", 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6827/2889617493", 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 1, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "d521eb0c-ea3e-46c6-8e5c-262df62043ab", 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 0.9004974365234375, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 45, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.280 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6802", 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6803", 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6804", 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6805", 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.282 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6808", 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6809", 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.283 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6806", 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6807", 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3955072152 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6803/3955072152", 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6805/3955072152", 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6809/3955072152", 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6807/3955072152", 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 2, 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "089f22b2-6c41-4854-af61-bb916f617ef5", 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 33, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6820", 2024-09-14T07:12:39.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6822", 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6824", 2024-09-14T07:12:39.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6826", 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6832", 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6833", 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6828", 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6830", 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3066758971 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6822/3066758971", 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6826/3066758971", 2024-09-14T07:12:39.290 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6833/3066758971", 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6830/3066758971", 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 3, 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "5a8d365e-a098-4d07-9927-647c4fc0b3da", 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 0.3750152587890625, 2024-09-14T07:12:39.291 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 45, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6810", 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6811", 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6812", 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6813", 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6816", 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6817", 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6814", 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6815", 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1876512586 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6811/1876512586", 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6813/1876512586", 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6817/1876512586", 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6815/1876512586", 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.296 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 4, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "13920f12-491b-4330-a5a2-fbf6c6f5242f", 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.297 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 45, 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6816", 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6817", 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6818", 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6819", 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6822", 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6823", 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6820", 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6821", 2024-09-14T07:12:39.301 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1898851107 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6817/1898851107", 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6819/1898851107", 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6823/1898851107", 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6821/1898851107", 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.302 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 5, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "5c838ac4-0108-4981-bdee-8a6ae76e1f22", 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 0, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 23, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 33, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6824", 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6825", 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6826", 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6827", 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6830", 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6831", 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6828", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6829", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1385217108 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6825/1385217108", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6827/1385217108", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6831/1385217108", 2024-09-14T07:12:39.307 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6829/1385217108", 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "exists" 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 6, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "e9aacee6-d441-4987-addf-617339375ef0", 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.308 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 50, 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6808", 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6809", 2024-09-14T07:12:39.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6810", 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6811", 2024-09-14T07:12:39.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6814", 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6815", 2024-09-14T07:12:39.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6812", 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6813", 2024-09-14T07:12:39.312 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1465682528 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6809/1465682528", 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6811/1465682528", 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6815/1465682528", 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6813/1465682528", 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.313 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 7, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "9e53e2c5-d137-442a-8ee8-9f8757a8e601", 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 0, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 14, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 33, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6800", 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6801", 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-09-14T07:12:39.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6802", 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6803", 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-09-14T07:12:39.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6806", 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6807", 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-09-14T07:12:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6804", 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.86:6805", 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2849091451 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.86:6801/2849091451", 2024-09-14T07:12:39.318 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.86:6803/2849091451", 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.86:6807/2849091451", 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.86:6805/2849091451", 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_xinfo": [ 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 0, 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.319 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.746971+0000", 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 1, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.202992+0000", 2024-09-14T07:12:39.320 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 2, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:32.026889+0000", 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 3, 2024-09-14T07:12:39.321 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.140575+0000", 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 4, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.322 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.188928+0000", 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 5, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.701967+0000", 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 33 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 6, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.242666+0000", 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 7, 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-09-14T07:12:39.324 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540719139924082687, 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-09-14T07:11:31.149131+0000", 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap": [], 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap_items": [ 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.11", 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:39.325 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 7, 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 4 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap_primaries": [], 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_temp": [], 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_temp": [], 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklist": {}, 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "range_blocklist": {}, 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profiles": { 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "default": { 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "crush-failure-domain": "osd", 2024-09-14T07:12:39.326 INFO:teuthology.orchestra.run.smithi071.stdout: "k": "2", 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "m": "1", 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin": "jerasure", 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "technique": "reed_sol_van" 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps_queue": [], 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "new_removed_snaps": [], 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "new_purged_snaps": [], 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_node_flags": {}, 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "device_class_flags": {}, 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": { 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode_enabled": false, 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_bucket_count": 0, 2024-09-14T07:12:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: "degraded_stretch_mode": 0, 2024-09-14T07:12:39.328 INFO:teuthology.orchestra.run.smithi071.stdout: "recovering_stretch_mode": 0, 2024-09-14T07:12:39.328 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode_bucket": 0 2024-09-14T07:12:39.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:39.328 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:39.330 INFO:tasks.thrashosds.thrasher:j is {'epoch': 64, 'fsid': '589dc63d-1bfc-48bf-bb57-35804a598e44', 'created': '2024-09-14T07:11:21.848766+0000', 'modified': '2024-09-14T07:12:38.886397+0000', 'last_up_change': '2024-09-14T07:12:02.678229+0000', 'last_in_change': '2024-09-14T07:11:24.880196+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T07:11:36.356620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7844390869140625, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.7799999713897705}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T07:11:40.724021+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.490000009536743, 'score_stable': 3.490000009536743, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.7844390869140625, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.7799999713897705}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T07:11:50.672481+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.d), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'baa123cb-89ef-45b4-8952-ad69f57110ad', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6818', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6819', 'nonce': 2889617493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6821', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6823', 'nonce': 2889617493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6829', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6831', 'nonce': 2889617493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6825', 'nonce': 2889617493}, {'type': 'v1', 'addr': '172.21.15.71:6827', 'nonce': 2889617493}]}, 'public_addr': '172.21.15.71:6819/2889617493', 'cluster_addr': '172.21.15.71:6823/2889617493', 'heartbeat_back_addr': '172.21.15.71:6831/2889617493', 'heartbeat_front_addr': '172.21.15.71:6827/2889617493', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd521eb0c-ea3e-46c6-8e5c-262df62043ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.9004974365234375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 3955072152}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6805', 'nonce': 3955072152}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6809', 'nonce': 3955072152}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 3955072152}, {'type': 'v1', 'addr': '172.21.15.71:6807', 'nonce': 3955072152}]}, 'public_addr': '172.21.15.71:6803/3955072152', 'cluster_addr': '172.21.15.71:6805/3955072152', 'heartbeat_back_addr': '172.21.15.71:6809/3955072152', 'heartbeat_front_addr': '172.21.15.71:6807/3955072152', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '089f22b2-6c41-4854-af61-bb916f617ef5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6820', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6822', 'nonce': 3066758971}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6824', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6826', 'nonce': 3066758971}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 3066758971}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6828', 'nonce': 3066758971}, {'type': 'v1', 'addr': '172.21.15.71:6830', 'nonce': 3066758971}]}, 'public_addr': '172.21.15.71:6822/3066758971', 'cluster_addr': '172.21.15.71:6826/3066758971', 'heartbeat_back_addr': '172.21.15.71:6833/3066758971', 'heartbeat_front_addr': '172.21.15.71:6830/3066758971', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '5a8d365e-a098-4d07-9927-647c4fc0b3da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3750152587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6810', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6811', 'nonce': 1876512586}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6813', 'nonce': 1876512586}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6816', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6817', 'nonce': 1876512586}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 1876512586}, {'type': 'v1', 'addr': '172.21.15.71:6815', 'nonce': 1876512586}]}, 'public_addr': '172.21.15.71:6811/1876512586', 'cluster_addr': '172.21.15.71:6813/1876512586', 'heartbeat_back_addr': '172.21.15.71:6817/1876512586', 'heartbeat_front_addr': '172.21.15.71:6815/1876512586', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '13920f12-491b-4330-a5a2-fbf6c6f5242f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6816', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6817', 'nonce': 1898851107}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 1898851107}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6823', 'nonce': 1898851107}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6820', 'nonce': 1898851107}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 1898851107}]}, 'public_addr': '172.21.15.86:6817/1898851107', 'cluster_addr': '172.21.15.86:6819/1898851107', 'heartbeat_back_addr': '172.21.15.86:6823/1898851107', 'heartbeat_front_addr': '172.21.15.86:6821/1898851107', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5c838ac4-0108-4981-bdee-8a6ae76e1f22', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 33, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 1385217108}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6826', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 1385217108}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6830', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 1385217108}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 1385217108}, {'type': 'v1', 'addr': '172.21.15.86:6829', 'nonce': 1385217108}]}, 'public_addr': '172.21.15.86:6825/1385217108', 'cluster_addr': '172.21.15.86:6827/1385217108', 'heartbeat_back_addr': '172.21.15.86:6831/1385217108', 'heartbeat_front_addr': '172.21.15.86:6829/1385217108', 'state': ['exists']}, {'osd': 6, 'uuid': 'e9aacee6-d441-4987-addf-617339375ef0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6809', 'nonce': 1465682528}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 1465682528}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6814', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6815', 'nonce': 1465682528}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6812', 'nonce': 1465682528}, {'type': 'v1', 'addr': '172.21.15.86:6813', 'nonce': 1465682528}]}, 'public_addr': '172.21.15.86:6809/1465682528', 'cluster_addr': '172.21.15.86:6811/1465682528', 'heartbeat_back_addr': '172.21.15.86:6815/1465682528', 'heartbeat_front_addr': '172.21.15.86:6813/1465682528', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9e53e2c5-d137-442a-8ee8-9f8757a8e601', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6801', 'nonce': 2849091451}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6802', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 2849091451}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6806', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 2849091451}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 2849091451}, {'type': 'v1', 'addr': '172.21.15.86:6805', 'nonce': 2849091451}]}, 'public_addr': '172.21.15.86:6801/2849091451', 'cluster_addr': '172.21.15.86:6803/2849091451', 'heartbeat_back_addr': '172.21.15.86:6807/2849091451', 'heartbeat_front_addr': '172.21.15.86:6805/2849091451', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.746971+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.202992+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:32.026889+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.140575+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.188928+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.701967+0000', 'dead_epoch': 33}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.242666+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T07:11:31.149131+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.11', 'mappings': [{'from': 7, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T07:12:39.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:12:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:4006 writesame 0x4cd9508 thru 0x4cdb459 data_size 0x2(0x1f52 bytes) 2024-09-14T07:12:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:4008 write 0x8d3a104 thru 0x8d3c9b0 (0x28ad bytes) 2024-09-14T07:12:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:4009 write 0x71af6e7 thru 0x71b923c (0x9b56 bytes) 2024-09-14T07:12:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:4011 writesame 0x7c5ab33 thru 0x7c6a782 data_size 0x58(0xfc50 bytes) 2024-09-14T07:12:39.332 INFO:teuthology.orchestra.run.smithi071.stdout:4012 write 0xc9ce40f thru 0xc9db1c2 (0xcdb4 bytes) 2024-09-14T07:12:39.332 INFO:teuthology.orchestra.run.smithi071.stdout:4013 write 0x3affc7c thru 0x3b0fbc8 (0xff4d bytes) 2024-09-14T07:12:39.332 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:39.328+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:39.339 INFO:teuthology.orchestra.run.smithi071.stdout:4015 punch from 0x6a77bbc to 0x6a7e87c, (0x6cc0 bytes) 2024-09-14T07:12:39.339 INFO:teuthology.orchestra.run.smithi071.stdout:4018 read 0xb19220e thru 0xb1a1875 (0xf668 bytes) 2024-09-14T07:12:39.339 INFO:teuthology.orchestra.run.smithi071.stdout:4019 write 0x3b8574c thru 0x3b87ba1 (0x2456 bytes) 2024-09-14T07:12:39.341 INFO:teuthology.orchestra.run.smithi071.stdout:4021 read 0x63026fc thru 0x630a4da (0x7ddf bytes) 2024-09-14T07:12:39.341 INFO:teuthology.orchestra.run.smithi071.stdout:4022 write 0x939b8b6 thru 0x939fdcd (0x4518 bytes) 2024-09-14T07:12:39.349 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:39.349 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:39.349 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:39.349 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:39.350 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:39.350 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:39.350 INFO:teuthology.orchestra.run.smithi071.stdout:4026 write 0xa2481e5 thru 0xa2498d4 (0x16f0 bytes) 2024-09-14T07:12:39.355 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:39.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:39.362 INFO:teuthology.orchestra.run.smithi071.stdout:4028 writesame 0xe156f01 thru 0xe15f499 data_size 0x1(0x8599 bytes) 2024-09-14T07:12:39.362 INFO:teuthology.orchestra.run.smithi071.stdout:4030 write 0x57a422a thru 0x57af7e8 (0xb5bf bytes) 2024-09-14T07:12:39.367 INFO:teuthology.orchestra.run.smithi071.stdout:4031 write 0x917c64a thru 0x9183c27 (0x75de bytes) 2024-09-14T07:12:39.376 INFO:teuthology.orchestra.run.smithi071.stdout:4032 trunc from 0xe15f49a to 0x997964d 2024-09-14T07:12:39.386 INFO:teuthology.orchestra.run.smithi071.stdout:4033 writesame 0x5f9d5e0 thru 0x5face11 data_size 0x1(0xf832 bytes) 2024-09-14T07:12:39.405 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:39.405 INFO:teuthology.orchestra.run.smithi071.stdout:4037 read 0x88dbcfc thru 0x88ea646 (0xe94b bytes) 2024-09-14T07:12:39.405 INFO:teuthology.orchestra.run.smithi071.stdout:4038 write 0xb91945 thru 0xb993dd (0x7a99 bytes) 2024-09-14T07:12:39.430 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:39.429+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:39.449 INFO:teuthology.orchestra.run.smithi071.stdout:4039 read 0x1d2010a thru 0x1d289ae (0x88a5 bytes) 2024-09-14T07:12:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:4041 read 0x47876b3 thru 0x478a851 (0x319f bytes) 2024-09-14T07:12:39.451 INFO:teuthology.orchestra.run.smithi071.stdout:4042 read 0x1882136 thru 0x18903cb (0xe296 bytes) 2024-09-14T07:12:39.464 INFO:teuthology.orchestra.run.smithi071.stdout:4044 writesame 0xe996ebe thru 0xe999028 data_size 0x1d(0x216b bytes) 2024-09-14T07:12:39.464 INFO:teuthology.orchestra.run.smithi071.stdout:4045 punch from 0x1844d17 to 0x1845715, (0x9fe bytes) 2024-09-14T07:12:39.464 INFO:teuthology.orchestra.run.smithi071.stdout:4046 writesame 0x3c4f12a thru 0x3c5389f data_size 0x3(0x4776 bytes) 2024-09-14T07:12:39.473 INFO:teuthology.orchestra.run.smithi071.stdout:4047 trunc from 0xe999029 to 0xe3bb842 2024-09-14T07:12:39.479 INFO:teuthology.orchestra.run.smithi071.stdout:4051 clone 28 order 23 su 32768 sc 7 2024-09-14T07:12:39.507 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:39.507 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:39.507 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:39.507 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:39.507 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:39.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:39.531 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:39.530+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:39.619 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.483210292999999, 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.620 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:39.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:39.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:39.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:39.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:39.627 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.927893771000001, 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:39.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.634 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707620874, 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:12:39.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:12:39.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707599182999999, 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.641 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:12:39.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707579280000001, 2024-09-14T07:12:39.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.649 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707557785999999, 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.654 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707539465, 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:12:39.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:12:39.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707513122000002, 2024-09-14T07:12:39.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:39.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:12:39.663 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707492657, 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.664 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:12:39.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:12:39.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.669 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707470802, 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:12:39.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:12:39.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707452167, 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:12:39.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:12:39.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707426026, 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:12:39.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:12:39.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707398508000001, 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.685 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707381029, 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:12:39.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:12:39.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:12:39.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.707368913, 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.695 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.699 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.701926895, 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.700 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.701907571, 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.704 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:12:39.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.701878721, 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.709 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:39.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.701838197000001, 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:12:39.713 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:12:39.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:12:39.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.701816172000001, 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:39.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:39.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:12:39.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:12:39.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:12:39.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.723 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:39.723 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:39.723 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:39.725 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:12:39.726 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:12:39.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:39.728 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-09-14T07:12:38.890991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1031962203,"num_objects":912,"num_object_clones":266,"num_object_copies":1824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":252,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":238,"num_read":82809,"num_read_kb":427490,"num_write":10233,"num_write_kb":235187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8082,"ondisk_log_size":8082,"up":71,"acting":71,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":527084,"kb_used_data":252620,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754447636,"statfs":{"total":773094113280,"available":772554379264,"internally_reserved":0,"allocated":258682880,"data_stored":349541425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":280874545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":88408661,"num_objects":167,"num_object_clones":48,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":59,"num_read":10638,"num_read_kb":35590,"num_write":1759,"num_write_kb":26152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.030271"},"pg_stats":[{"pgid":"3.1f","version":"61'337","reported_seq":2889,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.096287+0000","last_change":"2024-09-14T07:12:03.687446+0000","last_active":"2024-09-14T07:12:34.096287+0000","last_peered":"2024-09-14T07:12:34.096287+0000","last_clean":"2024-09-14T07:12:02.182986+0000","last_became_active":"2024-09-14T07:12:03.687446+0000","last_became_peered":"2024-09-14T07:12:03.687446+0000","last_unstale":"2024-09-14T07:12:34.096287+0000","last_undegraded":"2024-09-14T07:12:03.686750+0000","last_fullsized":"2024-09-14T07:12:03.686663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:51.806197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012858609999999999,"stat_sum":{"num_bytes":16061008,"num_objects":37,"num_object_clones":14,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":37,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":14,"num_read":4002,"num_read_kb":14859,"num_write":495,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":37}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"61'150","reported_seq":1912,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.860124+0000","last_change":"2024-09-14T07:12:21.795713+0000","last_active":"2024-09-14T07:12:34.860124+0000","last_peered":"2024-09-14T07:12:34.860124+0000","last_clean":"2024-09-14T07:12:34.860124+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:12:34.860124+0000","last_undegraded":"2024-09-14T07:12:34.860124+0000","last_fullsized":"2024-09-14T07:12:34.860124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:52.674048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079792100000000005,"stat_sum":{"num_bytes":25700198,"num_objects":32,"num_object_clones":11,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":1696,"num_read_kb":13562,"num_write":172,"num_write_kb":17213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"61'124","reported_seq":1397,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.499428+0000","last_change":"2024-09-14T07:12:03.689201+0000","last_active":"2024-09-14T07:12:34.499428+0000","last_peered":"2024-09-14T07:12:34.499428+0000","last_clean":"2024-09-14T07:12:01.804976+0000","last_became_active":"2024-09-14T07:12:03.689201+0000","last_became_peered":"2024-09-14T07:12:03.689201+0000","last_unstale":"2024-09-14T07:12:34.499428+0000","last_undegraded":"2024-09-14T07:12:03.688117+0000","last_fullsized":"2024-09-14T07:12:03.688034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:13.580374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001026585,"stat_sum":{"num_bytes":17514803,"num_objects":20,"num_object_clones":6,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":1203,"num_read_kb":7697,"num_write":126,"num_write_kb":3910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":20}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"61'192","reported_seq":1076,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.850108+0000","last_change":"2024-09-14T07:12:03.688976+0000","last_active":"2024-09-14T07:12:34.850108+0000","last_peered":"2024-09-14T07:12:34.850108+0000","last_clean":"2024-09-14T07:12:02.077164+0000","last_became_active":"2024-09-14T07:12:03.688976+0000","last_became_peered":"2024-09-14T07:12:03.688976+0000","last_unstale":"2024-09-14T07:12:34.850108+0000","last_undegraded":"2024-09-14T07:12:03.688136+0000","last_fullsized":"2024-09-14T07:12:03.688019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:17.516424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088611199999999999,"stat_sum":{"num_bytes":62529556,"num_objects":39,"num_object_clones":15,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":39,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":1103,"num_read_kb":11420,"num_write":195,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":39}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"61'198","reported_seq":2199,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.432084+0000","last_change":"2024-09-14T07:11:53.652707+0000","last_active":"2024-09-14T07:12:34.432084+0000","last_peered":"2024-09-14T07:12:34.432084+0000","last_clean":"2024-09-14T07:12:34.432084+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:12:34.432084+0000","last_undegraded":"2024-09-14T07:12:34.432084+0000","last_fullsized":"2024-09-14T07:12:34.432084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:25.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062975399999999995,"stat_sum":{"num_bytes":13385999,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":2177,"num_read_kb":9471,"num_write":234,"num_write_kb":2328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'544","reported_seq":1989,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.854801+0000","last_change":"2024-09-14T07:11:53.643789+0000","last_active":"2024-09-14T07:12:34.854801+0000","last_peered":"2024-09-14T07:12:34.854801+0000","last_clean":"2024-09-14T07:12:34.854801+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:12:34.854801+0000","last_undegraded":"2024-09-14T07:12:34.854801+0000","last_fullsized":"2024-09-14T07:12:34.854801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.092093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078296400000000003,"stat_sum":{"num_bytes":58091041,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":3598,"num_read_kb":25578,"num_write":893,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"61'177","reported_seq":4168,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.798427+0000","last_change":"2024-09-14T07:11:53.641714+0000","last_active":"2024-09-14T07:12:34.798427+0000","last_peered":"2024-09-14T07:12:34.798427+0000","last_clean":"2024-09-14T07:12:34.798427+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:12:34.798427+0000","last_undegraded":"2024-09-14T07:12:34.798427+0000","last_fullsized":"2024-09-14T07:12:34.798427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:53.229312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039260599999999999,"stat_sum":{"num_bytes":28963565,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":14,"num_read":4012,"num_read_kb":13843,"num_write":185,"num_write_kb":3486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"61'183","reported_seq":1614,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.792595+0000","last_change":"2024-09-14T07:12:21.799027+0000","last_active":"2024-09-14T07:12:34.792595+0000","last_peered":"2024-09-14T07:12:34.792595+0000","last_clean":"2024-09-14T07:12:34.792595+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:12:34.792595+0000","last_undegraded":"2024-09-14T07:12:34.792595+0000","last_fullsized":"2024-09-14T07:12:34.792595+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:52.063833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051195600000000004,"stat_sum":{"num_bytes":31136703,"num_objects":24,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":1844,"num_read_kb":23930,"num_write":220,"num_write_kb":10827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"61'395","reported_seq":3172,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.093554+0000","last_change":"2024-09-14T07:12:03.690079+0000","last_active":"2024-09-14T07:12:34.093554+0000","last_peered":"2024-09-14T07:12:34.093554+0000","last_clean":"2024-09-14T07:12:02.049833+0000","last_became_active":"2024-09-14T07:12:03.690079+0000","last_became_peered":"2024-09-14T07:12:03.690079+0000","last_unstale":"2024-09-14T07:12:34.093554+0000","last_undegraded":"2024-09-14T07:12:03.686958+0000","last_fullsized":"2024-09-14T07:12:03.686872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:43.726395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099453200000000001,"stat_sum":{"num_bytes":21752148,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":2,"num_read":4980,"num_read_kb":18876,"num_write":517,"num_write_kb":6230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":19}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"61'340","reported_seq":1734,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.803188+0000","last_change":"2024-09-14T07:12:03.694320+0000","last_active":"2024-09-14T07:12:34.803188+0000","last_peered":"2024-09-14T07:12:34.803188+0000","last_clean":"2024-09-14T07:12:02.114005+0000","last_became_active":"2024-09-14T07:12:03.694320+0000","last_became_peered":"2024-09-14T07:12:03.694320+0000","last_unstale":"2024-09-14T07:12:34.803188+0000","last_undegraded":"2024-09-14T07:12:03.691993+0000","last_fullsized":"2024-09-14T07:12:03.691911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:01.887042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106477,"stat_sum":{"num_bytes":22582453,"num_objects":25,"num_object_clones":8,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":2828,"num_read_kb":6782,"num_write":482,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":25}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"60'219","reported_seq":513,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.872798+0000","last_change":"2024-09-14T07:12:15.765427+0000","last_active":"2024-09-14T07:12:33.872798+0000","last_peered":"2024-09-14T07:12:33.872798+0000","last_clean":"2024-09-14T07:12:33.872798+0000","last_became_active":"2024-09-14T07:12:15.764942+0000","last_became_peered":"2024-09-14T07:12:15.764942+0000","last_unstale":"2024-09-14T07:12:33.872798+0000","last_undegraded":"2024-09-14T07:12:33.872798+0000","last_fullsized":"2024-09-14T07:12:33.872798+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:36.145547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060585999999999995,"stat_sum":{"num_bytes":23927823,"num_objects":25,"num_object_clones":8,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":879,"num_read_kb":7062,"num_write":272,"num_write_kb":4735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"61'320","reported_seq":1199,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.877832+0000","last_change":"2024-09-14T07:11:53.643815+0000","last_active":"2024-09-14T07:12:34.877832+0000","last_peered":"2024-09-14T07:12:34.877832+0000","last_clean":"2024-09-14T07:12:34.877832+0000","last_became_active":"2024-09-14T07:11:51.642949+0000","last_became_peered":"2024-09-14T07:11:51.642949+0000","last_unstale":"2024-09-14T07:12:34.877832+0000","last_undegraded":"2024-09-14T07:12:34.877832+0000","last_fullsized":"2024-09-14T07:12:34.877832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:51.966642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075362300000000003,"stat_sum":{"num_bytes":18073078,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":8,"num_read":1902,"num_read_kb":6703,"num_write":467,"num_write_kb":983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.862566+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:12:33.862566+0000","last_peered":"2024-09-14T07:12:33.862566+0000","last_clean":"2024-09-14T07:12:33.862566+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:12:33.862566+0000","last_undegraded":"2024-09-14T07:12:33.862566+0000","last_fullsized":"2024-09-14T07:12:33.862566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"61'528","reported_seq":2839,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.800346+0000","last_change":"2024-09-14T07:11:53.652733+0000","last_active":"2024-09-14T07:12:34.800346+0000","last_peered":"2024-09-14T07:12:34.800346+0000","last_clean":"2024-09-14T07:12:34.800346+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:12:34.800346+0000","last_undegraded":"2024-09-14T07:12:34.800346+0000","last_fullsized":"2024-09-14T07:12:34.800346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:38.414985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000363259,"stat_sum":{"num_bytes":45602974,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":4,"num_read":5092,"num_read_kb":24617,"num_write":689,"num_write_kb":7721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.867137+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:12:33.867137+0000","last_peered":"2024-09-14T07:12:33.867137+0000","last_clean":"2024-09-14T07:12:33.867137+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:12:33.867137+0000","last_undegraded":"2024-09-14T07:12:33.867137+0000","last_fullsized":"2024-09-14T07:12:33.867137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"61'157","reported_seq":2354,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.430231+0000","last_change":"2024-09-14T07:11:53.640613+0000","last_active":"2024-09-14T07:12:34.430231+0000","last_peered":"2024-09-14T07:12:34.430231+0000","last_clean":"2024-09-14T07:12:34.430231+0000","last_became_active":"2024-09-14T07:11:51.646069+0000","last_became_peered":"2024-09-14T07:11:51.646069+0000","last_unstale":"2024-09-14T07:12:34.430231+0000","last_undegraded":"2024-09-14T07:12:34.430231+0000","last_fullsized":"2024-09-14T07:12:34.430231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:16.293613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000781688,"stat_sum":{"num_bytes":6614538,"num_objects":14,"num_object_clones":5,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":3055,"num_read_kb":6176,"num_write":152,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.866299+0000","last_change":"2024-09-14T07:12:15.765521+0000","last_active":"2024-09-14T07:12:33.866299+0000","last_peered":"2024-09-14T07:12:33.866299+0000","last_clean":"2024-09-14T07:12:33.866299+0000","last_became_active":"2024-09-14T07:12:15.765216+0000","last_became_peered":"2024-09-14T07:12:15.765216+0000","last_unstale":"2024-09-14T07:12:33.866299+0000","last_undegraded":"2024-09-14T07:12:33.866299+0000","last_fullsized":"2024-09-14T07:12:33.866299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.152750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"61'435","reported_seq":1552,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.889914+0000","last_change":"2024-09-14T07:11:53.641816+0000","last_active":"2024-09-14T07:12:34.889914+0000","last_peered":"2024-09-14T07:12:34.889914+0000","last_clean":"2024-09-14T07:12:34.889914+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:12:34.889914+0000","last_undegraded":"2024-09-14T07:12:34.889914+0000","last_fullsized":"2024-09-14T07:12:34.889914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:55:37.709285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046618899999999999,"stat_sum":{"num_bytes":31636392,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":8,"num_read":3883,"num_read_kb":11166,"num_write":589,"num_write_kb":5673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.867041+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:12:33.867041+0000","last_peered":"2024-09-14T07:12:33.867041+0000","last_clean":"2024-09-14T07:12:33.867041+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:12:33.867041+0000","last_undegraded":"2024-09-14T07:12:33.867041+0000","last_fullsized":"2024-09-14T07:12:33.867041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"61'440","reported_seq":617,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.795238+0000","last_change":"2024-09-14T07:12:03.695737+0000","last_active":"2024-09-14T07:12:34.795238+0000","last_peered":"2024-09-14T07:12:34.795238+0000","last_clean":"2024-09-14T07:12:02.196630+0000","last_became_active":"2024-09-14T07:12:03.695737+0000","last_became_peered":"2024-09-14T07:12:03.695737+0000","last_unstale":"2024-09-14T07:12:34.795238+0000","last_undegraded":"2024-09-14T07:12:03.690877+0000","last_fullsized":"2024-09-14T07:12:03.690785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:49.798501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094557899999999999,"stat_sum":{"num_bytes":20714017,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":32,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":11,"num_read":1565,"num_read_kb":8966,"num_write":642,"num_write_kb":13352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":32}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"61'154","reported_seq":1400,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.796145+0000","last_change":"2024-09-14T07:11:53.643999+0000","last_active":"2024-09-14T07:12:34.796145+0000","last_peered":"2024-09-14T07:12:34.796145+0000","last_clean":"2024-09-14T07:12:34.796145+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:12:34.796145+0000","last_undegraded":"2024-09-14T07:12:34.796145+0000","last_fullsized":"2024-09-14T07:12:34.796145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:26.821682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091878800000000003,"stat_sum":{"num_bytes":47483329,"num_objects":24,"num_object_clones":8,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":1193,"num_read_kb":12263,"num_write":216,"num_write_kb":13229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":81,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:33.867504+0000","last_change":"2024-09-14T07:12:03.687245+0000","last_active":"2024-09-14T07:12:33.867504+0000","last_peered":"2024-09-14T07:12:33.867504+0000","last_clean":"2024-09-14T07:11:44.172729+0000","last_became_active":"2024-09-14T07:12:03.687245+0000","last_became_peered":"2024-09-14T07:12:03.687245+0000","last_unstale":"2024-09-14T07:12:33.867504+0000","last_undegraded":"2024-09-14T07:12:03.686553+0000","last_fullsized":"2024-09-14T07:12:03.686434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:17.889127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"61'152","reported_seq":3433,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.796473+0000","last_change":"2024-09-14T07:11:53.642216+0000","last_active":"2024-09-14T07:12:34.796473+0000","last_peered":"2024-09-14T07:12:34.796473+0000","last_clean":"2024-09-14T07:12:34.796473+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:12:34.796473+0000","last_undegraded":"2024-09-14T07:12:34.796473+0000","last_fullsized":"2024-09-14T07:12:34.796473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:38.247992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036810599999999999,"stat_sum":{"num_bytes":53964724,"num_objects":30,"num_object_clones":10,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":3544,"num_read_kb":25428,"num_write":147,"num_write_kb":7927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.925268+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:12:33.925268+0000","last_peered":"2024-09-14T07:12:33.925268+0000","last_clean":"2024-09-14T07:12:33.925268+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:12:33.925268+0000","last_undegraded":"2024-09-14T07:12:33.925268+0000","last_fullsized":"2024-09-14T07:12:33.925268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'165","reported_seq":2432,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.792751+0000","last_change":"2024-09-14T07:11:53.652453+0000","last_active":"2024-09-14T07:12:34.792751+0000","last_peered":"2024-09-14T07:12:34.792751+0000","last_clean":"2024-09-14T07:12:34.792751+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:12:34.792751+0000","last_undegraded":"2024-09-14T07:12:34.792751+0000","last_fullsized":"2024-09-14T07:12:34.792751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:52.692704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045273699999999999,"stat_sum":{"num_bytes":37975931,"num_objects":25,"num_object_clones":8,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":2245,"num_read_kb":19616,"num_write":189,"num_write_kb":16096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.867369+0000","last_change":"2024-09-14T07:12:15.765297+0000","last_active":"2024-09-14T07:12:33.867369+0000","last_peered":"2024-09-14T07:12:33.867369+0000","last_clean":"2024-09-14T07:12:33.867369+0000","last_became_active":"2024-09-14T07:12:15.765018+0000","last_became_peered":"2024-09-14T07:12:15.765018+0000","last_unstale":"2024-09-14T07:12:33.867369+0000","last_undegraded":"2024-09-14T07:12:33.867369+0000","last_fullsized":"2024-09-14T07:12:33.867369+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:02.766098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"61'117","reported_seq":1291,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.285826+0000","last_change":"2024-09-14T07:12:03.695806+0000","last_active":"2024-09-14T07:12:34.285826+0000","last_peered":"2024-09-14T07:12:34.285826+0000","last_clean":"2024-09-14T07:12:02.182931+0000","last_became_active":"2024-09-14T07:12:03.695806+0000","last_became_peered":"2024-09-14T07:12:03.695806+0000","last_unstale":"2024-09-14T07:12:34.285826+0000","last_undegraded":"2024-09-14T07:12:03.691035+0000","last_fullsized":"2024-09-14T07:12:03.690931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:15:57.038753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076532499999999997,"stat_sum":{"num_bytes":17639394,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":5,"num_read":1099,"num_read_kb":9671,"num_write":120,"num_write_kb":3600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":23}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":66,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:33.925276+0000","last_change":"2024-09-14T07:12:03.692906+0000","last_active":"2024-09-14T07:12:33.925276+0000","last_peered":"2024-09-14T07:12:33.925276+0000","last_clean":"2024-09-14T07:11:41.141514+0000","last_became_active":"2024-09-14T07:12:03.692906+0000","last_became_peered":"2024-09-14T07:12:03.692906+0000","last_unstale":"2024-09-14T07:12:33.925276+0000","last_undegraded":"2024-09-14T07:12:03.691045+0000","last_fullsized":"2024-09-14T07:12:03.690955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:46.939810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":139,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.866816+0000","last_change":"2024-09-14T07:12:15.764696+0000","last_active":"2024-09-14T07:12:33.866816+0000","last_peered":"2024-09-14T07:12:33.866816+0000","last_clean":"2024-09-14T07:12:33.866816+0000","last_became_active":"2024-09-14T07:12:15.764436+0000","last_became_peered":"2024-09-14T07:12:15.764436+0000","last_unstale":"2024-09-14T07:12:33.866816+0000","last_undegraded":"2024-09-14T07:12:33.866816+0000","last_fullsized":"2024-09-14T07:12:33.866816+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'325","reported_seq":2544,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.794546+0000","last_change":"2024-09-14T07:11:53.640836+0000","last_active":"2024-09-14T07:12:34.794546+0000","last_peered":"2024-09-14T07:12:34.794546+0000","last_clean":"2024-09-14T07:12:34.794546+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:12:34.794546+0000","last_undegraded":"2024-09-14T07:12:34.794546+0000","last_fullsized":"2024-09-14T07:12:34.794546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:37:27.210263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079425600000000002,"stat_sum":{"num_bytes":16987102,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":7,"num_read":4179,"num_read_kb":16996,"num_write":407,"num_write_kb":6671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"61'179","reported_seq":1821,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.799748+0000","last_change":"2024-09-14T07:11:53.644030+0000","last_active":"2024-09-14T07:12:34.799748+0000","last_peered":"2024-09-14T07:12:34.799748+0000","last_clean":"2024-09-14T07:12:34.799748+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:12:34.799748+0000","last_undegraded":"2024-09-14T07:12:34.799748+0000","last_fullsized":"2024-09-14T07:12:34.799748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:28.362359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090377899999999995,"stat_sum":{"num_bytes":25622285,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":7,"num_read":2560,"num_read_kb":10895,"num_write":186,"num_write_kb":4074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"61'265","reported_seq":1080,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.795813+0000","last_change":"2024-09-14T07:11:54.071502+0000","last_active":"2024-09-14T07:12:34.795813+0000","last_peered":"2024-09-14T07:12:34.795813+0000","last_clean":"2024-09-14T07:12:34.795813+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:12:34.795813+0000","last_undegraded":"2024-09-14T07:12:34.795813+0000","last_fullsized":"2024-09-14T07:12:34.795813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:51:22.576261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031753199999999998,"stat_sum":{"num_bytes":38124764,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":8,"num_read":1151,"num_read_kb":23955,"num_write":314,"num_write_kb":33506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"61'139","reported_seq":1828,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.694886+0000","last_change":"2024-09-14T07:12:21.798789+0000","last_active":"2024-09-14T07:12:34.694886+0000","last_peered":"2024-09-14T07:12:34.694886+0000","last_clean":"2024-09-14T07:12:34.694886+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:12:34.694886+0000","last_undegraded":"2024-09-14T07:12:34.694886+0000","last_fullsized":"2024-09-14T07:12:34.694886+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:25.614280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052900400000000002,"stat_sum":{"num_bytes":72123610,"num_objects":34,"num_object_clones":11,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":11,"num_read":1626,"num_read_kb":12930,"num_write":139,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'221","reported_seq":3391,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.874420+0000","last_change":"2024-09-14T07:12:03.692955+0000","last_active":"2024-09-14T07:12:34.874420+0000","last_peered":"2024-09-14T07:12:34.874420+0000","last_clean":"2024-09-14T07:12:02.167669+0000","last_became_active":"2024-09-14T07:12:03.692955+0000","last_became_peered":"2024-09-14T07:12:03.692955+0000","last_unstale":"2024-09-14T07:12:34.874420+0000","last_undegraded":"2024-09-14T07:12:03.690846+0000","last_fullsized":"2024-09-14T07:12:03.690747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:38.726895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081047900000000002,"stat_sum":{"num_bytes":61154018,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":27,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":3,"num_read":3610,"num_read_kb":18856,"num_write":276,"num_write_kb":6809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":27}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"61'261","reported_seq":2421,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-14T07:12:34.493262+0000","last_change":"2024-09-14T07:12:03.696929+0000","last_active":"2024-09-14T07:12:34.493262+0000","last_peered":"2024-09-14T07:12:34.493262+0000","last_clean":"2024-09-14T07:12:02.196725+0000","last_became_active":"2024-09-14T07:12:03.696929+0000","last_became_peered":"2024-09-14T07:12:03.696929+0000","last_unstale":"2024-09-14T07:12:34.493262+0000","last_undegraded":"2024-09-14T07:12:03.692111+0000","last_fullsized":"2024-09-14T07:12:03.692065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:04.419971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072059800000000003,"stat_sum":{"num_bytes":24521370,"num_objects":28,"num_object_clones":7,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":28,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":8,"num_read":3184,"num_read_kb":11585,"num_write":292,"num_write_kb":2095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":28}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"61'99","reported_seq":1456,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.997286+0000","last_change":"2024-09-14T07:12:15.765724+0000","last_active":"2024-09-14T07:12:33.997286+0000","last_peered":"2024-09-14T07:12:33.997286+0000","last_clean":"2024-09-14T07:12:33.997286+0000","last_became_active":"2024-09-14T07:12:15.765001+0000","last_became_peered":"2024-09-14T07:12:15.765001+0000","last_unstale":"2024-09-14T07:12:33.997286+0000","last_undegraded":"2024-09-14T07:12:33.997286+0000","last_fullsized":"2024-09-14T07:12:33.997286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:39.433520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066558700000000004,"stat_sum":{"num_bytes":34696756,"num_objects":24,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":5,"num_read":1293,"num_read_kb":8702,"num_write":96,"num_write_kb":3615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"61'323","reported_seq":2409,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.544113+0000","last_change":"2024-09-14T07:12:15.766663+0000","last_active":"2024-09-14T07:12:34.544113+0000","last_peered":"2024-09-14T07:12:34.544113+0000","last_clean":"2024-09-14T07:12:34.544113+0000","last_became_active":"2024-09-14T07:12:15.764966+0000","last_became_peered":"2024-09-14T07:12:15.764966+0000","last_unstale":"2024-09-14T07:12:34.544113+0000","last_undegraded":"2024-09-14T07:12:34.544113+0000","last_fullsized":"2024-09-14T07:12:34.544113+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:20.544936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054667400000000003,"stat_sum":{"num_bytes":51921283,"num_objects":39,"num_object_clones":13,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":3601,"num_read_kb":15279,"num_write":389,"num_write_kb":7518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"61'327","reported_seq":748,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.800599+0000","last_change":"2024-09-14T07:11:54.071547+0000","last_active":"2024-09-14T07:12:34.800599+0000","last_peered":"2024-09-14T07:12:34.800599+0000","last_clean":"2024-09-14T07:12:34.800599+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:12:34.800599+0000","last_undegraded":"2024-09-14T07:12:34.800599+0000","last_fullsized":"2024-09-14T07:12:34.800599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:49:14.662712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032913099999999998,"stat_sum":{"num_bytes":17420979,"num_objects":29,"num_object_clones":8,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":7,"num_read":1712,"num_read_kb":7940,"num_write":445,"num_write_kb":6601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"61'161","reported_seq":1819,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.875068+0000","last_change":"2024-09-14T07:12:15.765421+0000","last_active":"2024-09-14T07:12:33.875068+0000","last_peered":"2024-09-14T07:12:33.875068+0000","last_clean":"2024-09-14T07:12:33.875068+0000","last_became_active":"2024-09-14T07:12:15.764948+0000","last_became_peered":"2024-09-14T07:12:15.764948+0000","last_unstale":"2024-09-14T07:12:33.875068+0000","last_undegraded":"2024-09-14T07:12:33.875068+0000","last_fullsized":"2024-09-14T07:12:33.875068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:43.297446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036086199999999999,"stat_sum":{"num_bytes":37166341,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":1888,"num_read_kb":6886,"num_write":168,"num_write_kb":4854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"61'206","reported_seq":2618,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:34.795630+0000","last_change":"2024-09-14T07:11:53.652524+0000","last_active":"2024-09-14T07:12:34.795630+0000","last_peered":"2024-09-14T07:12:34.795630+0000","last_clean":"2024-09-14T07:12:34.795630+0000","last_became_active":"2024-09-14T07:11:51.643426+0000","last_became_peered":"2024-09-14T07:11:51.643426+0000","last_unstale":"2024-09-14T07:12:34.795630+0000","last_undegraded":"2024-09-14T07:12:34.795630+0000","last_fullsized":"2024-09-14T07:12:34.795630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:25.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041604400000000002,"stat_sum":{"num_bytes":8897609,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":10,"num_read":3690,"num_read_kb":6184,"num_write":213,"num_write_kb":4757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"61'174","reported_seq":2320,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-14T07:12:33.875151+0000","last_change":"2024-09-14T07:12:15.766483+0000","last_active":"2024-09-14T07:12:33.875151+0000","last_peered":"2024-09-14T07:12:33.875151+0000","last_clean":"2024-09-14T07:12:33.875151+0000","last_became_active":"2024-09-14T07:12:15.765178+0000","last_became_peered":"2024-09-14T07:12:15.765178+0000","last_unstale":"2024-09-14T07:12:33.875151+0000","last_undegraded":"2024-09-14T07:12:33.875151+0000","last_fullsized":"2024-09-14T07:12:33.875151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:39.302884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039914099999999999,"stat_sum":{"num_bytes":41386025,"num_objects":22,"num_object_clones":4,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":2349,"num_read_kb":9541,"num_write":203,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1031371816,"num_objects":908,"num_object_clones":266,"num_object_copies":1816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":250,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":238,"num_read":82743,"num_read_kb":427435,"num_write":10130,"num_write_kb":233557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":255905792,"data_stored":349726364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8007,"ondisk_log_size":8007,"up":55,"acting":55,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56992,"kb_used_data":21636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94314848,"statfs":{"total":96636764160,"available":96578404352,"internally_reserved":0,"allocated":22155264,"data_stored":31182663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55120,"kb_used_data":23932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94316720,"statfs":{"total":96636764160,"available":96580321280,"internally_reserved":0,"allocated":24506368,"data_stored":32226048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":1216766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94564,"kb_used_data":55060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94277276,"statfs":{"total":96636764160,"available":96539930624,"internally_reserved":0,"allocated":56381440,"data_stored":73657716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87240,"kb_used_data":51896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94284600,"statfs":{"total":96636764160,"available":96547430400,"internally_reserved":0,"allocated":53141504,"data_stored":70581465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46448,"kb_used_data":15260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325392,"statfs":{"total":96636764160,"available":96589201408,"internally_reserved":0,"allocated":15626240,"data_stored":22798781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72960,"kb_used_data":37612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94298880,"statfs":{"total":96636764160,"available":96562053120,"internally_reserved":0,"allocated":38514688,"data_stored":55883201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81356,"kb_used_data":46004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94290484,"statfs":{"total":96636764160,"available":96553455616,"internally_reserved":0,"allocated":47108096,"data_stored":61994785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46247936,"data_stored":61520160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38670336,"data_stored":56421949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15347712,"data_stored":22905203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53641216,"data_stored":71486819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":55525376,"data_stored":73236313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":1112303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23801856,"data_stored":31912630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21721088,"data_stored":31130987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:12:39.730 INFO:tasks.thrashosds.thrasher:Setting 3.12 to [7, 4] 2024-09-14T07:12:39.730 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.12', '7', '4'] 2024-09-14T07:12:39.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.12 7 4 2024-09-14T07:12:39.731 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:39.724+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:39.826 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:39.824+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:39.873 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:39.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:39.873 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:39.873 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:39.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:39.926 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:39.926+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:39.984 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone27 from 0xe3bb842 (overlap 0x27b1118) to 0xfe06d6 2024-09-14T07:12:40.004 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:40.004 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:40.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:40.061 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:40.060+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:40.128 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:40.127+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:40.166 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20787 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1036288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303105824999999, 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073802193000000002, 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20787 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861518+0000", 2024-09-14T07:12:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861524+0000", 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861529+0000", 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3719999999999998e-06 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935021+0000", 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073492476000000001 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935106+0000", 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5463999999999994e-05 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935318+0000", 2024-09-14T07:12:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211623 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20788 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303088266, 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07400669, 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20788 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861534+0000", 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861540+0000", 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9309999999999996e-06 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861543+0000", 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861546+0000", 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935348+0000", 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073801781999999996 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935423+0000", 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5080000000000006e-05 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935540+0000", 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011749899999999999 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20798 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 528384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303072529000001, 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231058000000003, 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20798 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:40.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861550+0000", 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.017e-06 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861553+0000", 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.909e-06 2024-09-14T07:12:40.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861559+0000", 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935582+0000", 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074022663000000002 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935663+0000", 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1865000000000003e-05 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935780+0000", 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011686 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20799 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303056121000001, 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074466447000000005, 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.182 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20799 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861567+0000", 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861572+0000", 2024-09-14T07:12:40.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9609999999999996e-06 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861576+0000", 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935808+0000", 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231973000000007 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935878+0000", 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0143999999999998e-05 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936032+0000", 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153774 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20800 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303039546000001, 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074574472000000003, 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20800 2024-09-14T07:12:40.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861584+0000", 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7940000000000001e-06 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861596+0000", 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2092e-05 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861602+0000", 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936049+0000", 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074446734000000001 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936091+0000", 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1947999999999999e-05 2024-09-14T07:12:40.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936157+0000", 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5569999999999997e-05 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20801 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 868352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303013805999999, 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07473929, 2024-09-14T07:12:40.191 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20801 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7500000000000001e-07 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861610+0000", 2024-09-14T07:12:40.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.378e-06 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861614+0000", 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1459999999999998e-06 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861616+0000", 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.43e-06 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936172+0000", 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074555621000000002 2024-09-14T07:12:40.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936210+0000", 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8260000000000003e-05 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936347+0000", 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013718000000000001 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20802 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 643072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.303002358000001, 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075010695000000002, 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20802 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7700000000000003e-07 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861625+0000", 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8169999999999998e-06 2024-09-14T07:12:40.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861629+0000", 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8550000000000004e-06 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936409+0000", 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074779656 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936501+0000", 2024-09-14T07:12:40.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1933000000000002e-05 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936630+0000", 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129336 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20803 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 925696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:40.200 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302986942, 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075273382, 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20803 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.201 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.03e-07 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861637+0000", 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.703e-06 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861642+0000", 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3990000000000003e-06 2024-09-14T07:12:40.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861653+0000", 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0638999999999999e-05 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936659+0000", 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075006286000000005 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936700+0000", 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0649000000000003e-05 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936908+0000", 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020830299999999999 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20804 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 700416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.205 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302962033, 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505252999999994, 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20804 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6499999999999999e-07 2024-09-14T07:12:40.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861662+0000", 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2589999999999999e-06 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861668+0000", 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1070000000000001e-06 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861673+0000", 2024-09-14T07:12:40.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4909999999999999e-06 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936955+0000", 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075281854999999995 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937041+0000", 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5783000000000002e-05 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937165+0000", 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012429300000000001 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20805 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 983040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302942451, 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075862623000000004, 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20805 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:40.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861680+0000", 2024-09-14T07:12:40.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861682+0000", 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861687+0000", 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:12:40.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861692+0000", 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4270000000000001e-06 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937197+0000", 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505371000000002 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937280+0000", 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2848000000000004e-05 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937542+0000", 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000261826 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20806 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 757760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.215 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302923744000001, 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076006066999999997, 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20806 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:40.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861700+0000", 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5600000000000001e-06 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861705+0000", 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0760000000000002e-06 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861709+0000", 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3499999999999999e-06 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937567+0000", 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075857407000000002 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937627+0000", 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0457000000000001e-05 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937704+0000", 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6872000000000005e-05 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20807 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302907109, 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076214191000000001, 2024-09-14T07:12:40.220 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20807 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861717+0000", 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861722+0000", 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861733+0000", 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0898e-05 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937724+0000", 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075991264000000003 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937770+0000", 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5809000000000001e-05 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937929+0000", 2024-09-14T07:12:40.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158651 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20817 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302883991000002, 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076617540999999997, 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.225 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20817 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9700000000000003e-07 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861745+0000", 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1520000000000003e-06 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861749+0000", 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6030000000000001e-06 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861751+0000", 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4509999999999999e-06 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937964+0000", 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076212703000000007 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938051+0000", 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6681999999999994e-05 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938355+0000", 2024-09-14T07:12:40.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000304653 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20818 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302867212999999, 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076901419999999998, 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.230 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20818 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861755+0000", 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861756+0000", 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861758+0000", 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861761+0000", 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2740000000000002e-06 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938385+0000", 2024-09-14T07:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076624135999999995 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938464+0000", 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9232000000000003e-05 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938656+0000", 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019190400000000001 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.234 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20820 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 929792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302858393000001, 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077243888999999996, 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20820 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861764+0000", 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861777+0000", 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3089e-05 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861784+0000", 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861789+0000", 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938674+0000", 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076885242000000006 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938740+0000", 2024-09-14T07:12:40.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5790999999999994e-05 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939007+0000", 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026745499999999999 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20821 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 987136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302824332, 2024-09-14T07:12:40.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077536638000000005, 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20821 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:40.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861798+0000", 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861800+0000", 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.956e-06 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861807+0000", 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250000000000002e-06 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861812+0000", 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5469999999999998e-06 2024-09-14T07:12:40.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939032+0000", 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077220252000000003 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939146+0000", 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011423 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939334+0000", 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018782799999999999 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20823 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1044480~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.302803372, 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077848745999999996, 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20823 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861819+0000", 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.77e-07 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861820+0000", 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.792e-06 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861827+0000", 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8979999999999999e-06 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861832+0000", 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3630000000000004e-06 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939383+0000", 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077551163000000006 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939475+0000", 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2471000000000003e-05 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939667+0000", 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019168200000000001 2024-09-14T07:12:40.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.308074939000001, 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:12:40.249 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:12:40.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:12:40.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:12:40.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.308039326999999, 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:40.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:12:40.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:40.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.304998725000001, 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.266 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:40.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:12:40.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.273 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:40.274 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:40.275 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:40.273+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:40.375 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:40.374+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:40.434 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:40.435 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:40.435 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:40.435 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:40.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:40.485 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:40.484+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:40.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:40.487 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-14T07:12:40.490 INFO:teuthology.orchestra.run.smithi071.stdout:4052 write 0x16fcf6c thru 0x16ff44e (0x24e3 bytes) 2024-09-14T07:12:40.577 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:40.576+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:40.599 INFO:teuthology.orchestra.run.smithi071.stdout:4053 trunc from 0xe3bb842 to 0x1e1c660 2024-09-14T07:12:40.620 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:40.620 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:40.620 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:40.620 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:40.621 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:40.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:40.678 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:40.677+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:40.778 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:40.777+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:40.821 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783986443, 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:12:40.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783960970999999, 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783949298, 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:12:40.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:12:40.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783938523, 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:40.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:12:40.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783927982000002, 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:12:40.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783917513999999, 2024-09-14T07:12:40.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783907001999999, 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.850 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:12:40.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783896664, 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783886321000001, 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:12:40.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:12:40.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783867733000001, 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:12:40.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783856643, 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:12:40.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:12:40.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783845940999999, 2024-09-14T07:12:40.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:40.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:12:40.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783825191999998, 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:12:40.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783799331000001, 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:12:40.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783779495000001, 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.890 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:12:40.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783753871999998, 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783715062999999, 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.900 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:12:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.904 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.783694394000001, 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:12:40.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:12:40.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.778333463999999, 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:12:40.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.778318909999999, 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:12:40.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:12:40.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:40.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:40.918 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:40.919 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:12:40.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:40.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:40.921 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:40.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:40.923 INFO:teuthology.orchestra.run.smithi071.stderr:set 3.12 pg_upmap mapping to [7,4] 2024-09-14T07:12:40.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:40.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:40.924 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:40.919+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:40.927 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:40.927 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:40.928 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:40.949 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:40.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:40.975 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:40.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:40.979 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:40.979 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:41.021 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:41.020+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:41.035 INFO:teuthology.orchestra.run.smithi071.stdout:4054 write 0x551438f thru 0x551a9dd (0x664f bytes) 2024-09-14T07:12:41.041 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:41.054 INFO:teuthology.orchestra.run.smithi071.stdout:4057 write 0xb3fcdd6 thru 0xb402437 (0x5662 bytes) 2024-09-14T07:12:41.059 INFO:teuthology.orchestra.run.smithi071.stdout:4059 write 0x89abfe0 thru 0x89b55c4 (0x95e5 bytes) 2024-09-14T07:12:41.062 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.062 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.069 INFO:teuthology.orchestra.run.smithi071.stdout:4060 trunc from 0xb402438 to 0x63cc27a 2024-09-14T07:12:41.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:41.080 INFO:teuthology.orchestra.run.smithi071.stdout:4062 writesame 0x30a8780 thru 0x30b7584 data_size 0x13(0xee05 bytes) 2024-09-14T07:12:41.082 INFO:teuthology.orchestra.run.smithi071.stdout:4063 clone 29 order 22 su 32768 sc 10 2024-09-14T07:12:41.122 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:41.121+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:41.182 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.182 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:41.232 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:41.231+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:41.324 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:41.323+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:41.333 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.334 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:41.425 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:41.424+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:41.445 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.445 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.454 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:41.526 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:41.525+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:41.555 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.556 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:41.640 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:12:41.640 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:41.639+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:41.716 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.716 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:41.768 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:41.767+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:41.827 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.827 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.828 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:41.828+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:41.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:41.930 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:41.929+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:41.979 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:41.979 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:41.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:42.031 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:42.030+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:42.088 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.089 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:42.132 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:42.131+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:42.233 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:42.232+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:42.239 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.239 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:42.333 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:42.333+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:42.351 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.351 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:42.434 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:42.433+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:42.462 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.462 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:42.555 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:42.554+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:42.613 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.613 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:42.637 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:42.636+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:42.723 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone28 from 0x63cc27a (overlap 0x1e1c660) to 0x0 2024-09-14T07:12:42.737 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:42.737+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:42.778 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.778 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:42.838 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:42.837+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:42.867 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-14T07:12:42.912 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:42.912 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:42.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:42.969 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:42.968+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:42.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:43.039 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:43.039+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:43.076 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:43.076 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:43.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:43.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:43.144 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:43.143+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:43.166 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:43.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:43.180 INFO:teuthology.orchestra.run.smithi071.stdout:4064 read 0x5314137 thru 0x5314afc (0x9c6 bytes) 2024-09-14T07:12:43.181 INFO:teuthology.orchestra.run.smithi071.stdout:4066 read 0x23f137 thru 0x245b2b (0x69f5 bytes) 2024-09-14T07:12:43.182 INFO:teuthology.orchestra.run.smithi071.stdout:4067 read 0x55f779c thru 0x55fbff8 (0x485d bytes) 2024-09-14T07:12:43.183 INFO:teuthology.orchestra.run.smithi071.stdout:4068 read 0xcffc3f thru 0xd01031 (0x13f3 bytes) 2024-09-14T07:12:43.183 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:43.183 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:43.184 INFO:teuthology.orchestra.run.smithi071.stdout:4069 trunc from 0x63cc27a to 0x6ce81ec 2024-09-14T07:12:43.192 INFO:teuthology.orchestra.run.smithi071.stdout:4070 writesame 0x6ca7e80 thru 0x6caa9ac data_size 0x1(0x2b2d bytes) 2024-09-14T07:12:43.203 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:43.204 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:43.217 INFO:teuthology.orchestra.run.smithi071.stdout:4072 write 0x9d559dd thru 0x9d5fd1e (0xa342 bytes) 2024-09-14T07:12:43.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:43.225 INFO:teuthology.orchestra.run.smithi071.stdout:4073 writesame 0x8a59c3 thru 0x8ae231 data_size 0x1(0x886f bytes) 2024-09-14T07:12:43.241 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:43.241+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:43.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:43.252 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:43.253 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:43.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:43.268 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:43.271 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:43.272 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:43.279 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.279 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.290 INFO:teuthology.orchestra.run.smithi071.stdout:4076 writesame 0xe2be924 thru 0xe2cace9 data_size 0x3(0xc3c6 bytes) 2024-09-14T07:12:43.290 INFO:teuthology.orchestra.run.smithi071.stdout:4077 punch from 0xcc5d56d to 0xcc64b5b, (0x75ee bytes) 2024-09-14T07:12:43.290 INFO:teuthology.orchestra.run.smithi071.stdout:4078 read 0xadcf76f thru 0xadd6b8d (0x741f bytes) 2024-09-14T07:12:43.290 INFO:teuthology.orchestra.run.smithi071.stdout:4079 read 0x4d18431 thru 0x4d23eea (0xbaba bytes) 2024-09-14T07:12:43.290 INFO:teuthology.orchestra.run.smithi071.stdout:4080 writesame 0xb640f2c thru 0xb64c35e data_size 0x1(0xb433 bytes) 2024-09-14T07:12:43.308 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.322 INFO:teuthology.orchestra.run.smithi071.stdout:4082 trunc from 0xe2cacea to 0x1f9d658 2024-09-14T07:12:43.342 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:43.342+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:43.409 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:43.409 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:43.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:43.409 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:43.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20787 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1036288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546160729, 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073802193000000002, 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20787 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.410 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861516+0000", 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861518+0000", 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8959999999999999e-06 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861524+0000", 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861529+0000", 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3719999999999998e-06 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935021+0000", 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073492476000000001 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935106+0000", 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5463999999999994e-05 2024-09-14T07:12:43.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935318+0000", 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211623 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20788 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546143170000001, 2024-09-14T07:12:43.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07400669, 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20788 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.415 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861533+0000", 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861534+0000", 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-07 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861540+0000", 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9309999999999996e-06 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861543+0000", 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5609999999999999e-06 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861546+0000", 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935348+0000", 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.073801781999999996 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935423+0000", 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5080000000000006e-05 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935540+0000", 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011749899999999999 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20798 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 528384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546127432999999, 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231058000000003, 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20798 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861549+0000", 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:43.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861550+0000", 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.017e-06 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861553+0000", 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.909e-06 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861559+0000", 2024-09-14T07:12:43.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935582+0000", 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074022663000000002 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935663+0000", 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1865000000000003e-05 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935780+0000", 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011686 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20799 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546111024999998, 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074466447000000005, 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.424 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20799 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861566+0000", 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861567+0000", 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861572+0000", 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9609999999999996e-06 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861576+0000", 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935808+0000", 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074231973000000007 2024-09-14T07:12:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.935878+0000", 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0143999999999998e-05 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936032+0000", 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153774 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20800 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 585728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546094449999998, 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074574472000000003, 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20800 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.429 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861582+0000", 2024-09-14T07:12:43.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861584+0000", 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7940000000000001e-06 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861596+0000", 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2092e-05 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861602+0000", 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936049+0000", 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074446734000000001 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936091+0000", 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1947999999999999e-05 2024-09-14T07:12:43.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936157+0000", 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5569999999999997e-05 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20801 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 868352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:43.433 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.54606871, 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.07473929, 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20801 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861608+0000", 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7500000000000001e-07 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861610+0000", 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.378e-06 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861614+0000", 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1459999999999998e-06 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861616+0000", 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.43e-06 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936172+0000", 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074555621000000002 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936210+0000", 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8260000000000003e-05 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936347+0000", 2024-09-14T07:12:43.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013718000000000001 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20802 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 643072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546057262000001, 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075010695000000002, 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20802 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861619+0000", 2024-09-14T07:12:43.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861620+0000", 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7700000000000003e-07 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861625+0000", 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8169999999999998e-06 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861629+0000", 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8550000000000004e-06 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936409+0000", 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.074779656 2024-09-14T07:12:43.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936501+0000", 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1933000000000002e-05 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936630+0000", 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129336 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20803 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 925696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546041846000001, 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075273382, 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20803 2024-09-14T07:12:43.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861635+0000", 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.03e-07 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861637+0000", 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.703e-06 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861642+0000", 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3990000000000003e-06 2024-09-14T07:12:43.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861653+0000", 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0638999999999999e-05 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936659+0000", 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075006286000000005 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936700+0000", 2024-09-14T07:12:43.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0649000000000003e-05 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936908+0000", 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020830299999999999 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20804 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 700416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:43.447 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.546016937000001, 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505252999999994, 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20804 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861660+0000", 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6499999999999999e-07 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861662+0000", 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2589999999999999e-06 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861668+0000", 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1070000000000001e-06 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861673+0000", 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4909999999999999e-06 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.936955+0000", 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075281854999999995 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937041+0000", 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5783000000000002e-05 2024-09-14T07:12:43.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937165+0000", 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012429300000000001 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20805 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 983040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545997355000001, 2024-09-14T07:12:43.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075862623000000004, 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20805 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861679+0000", 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861680+0000", 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8200000000000001e-07 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861682+0000", 2024-09-14T07:12:43.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861687+0000", 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8780000000000003e-06 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861692+0000", 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4270000000000001e-06 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937197+0000", 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075505371000000002 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937280+0000", 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2848000000000004e-05 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937542+0000", 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000261826 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.456 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20806 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 757760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545978647999998, 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076006066999999997, 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.457 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20806 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861698+0000", 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4499999999999998e-07 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861700+0000", 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5600000000000001e-06 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861705+0000", 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0760000000000002e-06 2024-09-14T07:12:43.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861709+0000", 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3499999999999999e-06 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937567+0000", 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075857407000000002 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937627+0000", 2024-09-14T07:12:43.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0457000000000001e-05 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937704+0000", 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6872000000000005e-05 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20807 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:43.461 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545962013, 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076214191000000001, 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20807 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:43.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861715+0000", 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3000000000000002e-07 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861717+0000", 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861722+0000", 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861733+0000", 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0898e-05 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937724+0000", 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.075991264000000003 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937770+0000", 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5809000000000001e-05 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937929+0000", 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158651 2024-09-14T07:12:43.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20817 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 815104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545938894999999, 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076617540999999997, 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20817 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861738+0000", 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9700000000000003e-07 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861745+0000", 2024-09-14T07:12:43.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1520000000000003e-06 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861749+0000", 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6030000000000001e-06 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861751+0000", 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4509999999999999e-06 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.937964+0000", 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076212703000000007 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938051+0000", 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6681999999999994e-05 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938355+0000", 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000304653 2024-09-14T07:12:43.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20818 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545922117, 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076901419999999998, 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20818 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861754+0000", 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861755+0000", 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861756+0000", 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7199999999999997e-07 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861758+0000", 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861761+0000", 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2740000000000002e-06 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938385+0000", 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076624135999999995 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938464+0000", 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9232000000000003e-05 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938656+0000", 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019190400000000001 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20820 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 929792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545913296999998, 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077243888999999996, 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20820 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861763+0000", 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861764+0000", 2024-09-14T07:12:43.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861777+0000", 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3089e-05 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861784+0000", 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861789+0000", 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8600000000000001e-06 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938674+0000", 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.076885242000000006 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.938740+0000", 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5790999999999994e-05 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939007+0000", 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026745499999999999 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20821 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 987136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545879236000001, 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077536638000000005, 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20821 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861797+0000", 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861798+0000", 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861800+0000", 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.956e-06 2024-09-14T07:12:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861807+0000", 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3250000000000002e-06 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861812+0000", 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5469999999999998e-06 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939032+0000", 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077220252000000003 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939146+0000", 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011423 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939334+0000", 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018782799999999999 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:20823 3.17 3:ecae0514:::rbd_data.11824d7f600c.0000000000000003:f [read 1044480~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.545858276000001, 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077848745999999996, 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 20823 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861818+0000", 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861819+0000", 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.77e-07 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861820+0000", 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.792e-06 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861827+0000", 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8979999999999999e-06 2024-09-14T07:12:43.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.861832+0000", 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3630000000000004e-06 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939383+0000", 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.077551163000000006 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939475+0000", 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2471000000000003e-05 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.939667+0000", 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019168200000000001 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:43.489 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.551129842999998, 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:12:43.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.551094231, 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:12:43.496 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:12:43.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:12:43.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:12:43.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.548053629000002, 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:12:43.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:43.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.510 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:43.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:43.512 INFO:teuthology.orchestra.run.smithi071.stdout:4083 read 0x186c30c thru 0x1879588 (0xd27d bytes) 2024-09-14T07:12:43.512 INFO:teuthology.orchestra.run.smithi071.stdout:4084 read 0xdf7af2 thru 0xe05d22 (0xe231 bytes) 2024-09-14T07:12:43.512 INFO:teuthology.orchestra.run.smithi071.stdout:4085 punch from 0xa23310 to 0xa2d9ea, (0xa6da bytes) 2024-09-14T07:12:43.512 INFO:teuthology.orchestra.run.smithi071.stdout:4086 write 0x3052904 thru 0x306089d (0xdf9a bytes) 2024-09-14T07:12:43.512 INFO:teuthology.orchestra.run.smithi071.stdout:4087 write 0xacfd71e thru 0xacff14c (0x1a2f bytes) 2024-09-14T07:12:43.512 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:43.510+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:43.520 INFO:teuthology.orchestra.run.smithi071.stdout:4088 write 0xd661840 thru 0xd6629f2 (0x11b3 bytes) 2024-09-14T07:12:43.525 INFO:teuthology.orchestra.run.smithi071.stdout:4089 trunc from 0xd6629f3 to 0xb7b8177 2024-09-14T07:12:43.536 INFO:teuthology.orchestra.run.smithi071.stdout:4090 read 0xa9f4b9f thru 0xaa0139f (0xc801 bytes) 2024-09-14T07:12:43.536 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.536 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.536 INFO:teuthology.orchestra.run.smithi071.stdout:4096 read 0x139ff1f thru 0x13aabb1 (0xac93 bytes) 2024-09-14T07:12:43.536 INFO:teuthology.orchestra.run.smithi071.stdout:4098 read 0x146fa2e thru 0x146fc2a (0x1fd bytes) 2024-09-14T07:12:43.539 INFO:teuthology.orchestra.run.smithi071.stdout:4100 trunc from 0xb7b8177 to 0xd621f3f 2024-09-14T07:12:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:4101 read 0xcde0f86 thru 0xcde621a (0x5295 bytes) 2024-09-14T07:12:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:4103 write 0x381da6a thru 0x381f162 (0x16f9 bytes) 2024-09-14T07:12:43.547 INFO:teuthology.orchestra.run.smithi071.stdout:4104 write 0x9438d6d thru 0x9442a26 (0x9cba bytes) 2024-09-14T07:12:43.551 INFO:teuthology.orchestra.run.smithi071.stdout:4105 write 0x1993c80 thru 0x19a1408 (0xd789 bytes) 2024-09-14T07:12:43.558 INFO:teuthology.orchestra.run.smithi071.stdout:4106 write 0xe0e4a8d thru 0xe0ef7ec (0xad60 bytes) 2024-09-14T07:12:43.562 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.562 INFO:teuthology.orchestra.run.smithi071.stdout:4109 read 0xdf9ca9d thru 0xdfa2f9b (0x64ff bytes) 2024-09-14T07:12:43.562 INFO:teuthology.orchestra.run.smithi071.stdout:4110 read 0x32278e0 thru 0x323685f (0xef80 bytes) 2024-09-14T07:12:43.563 INFO:teuthology.orchestra.run.smithi071.stdout:4111 read 0x6c7914f thru 0x6c80f4a (0x7dfc bytes) 2024-09-14T07:12:43.563 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:43.563 INFO:teuthology.orchestra.run.smithi071.stdout:4113 punch from 0xc62ec37 to 0xc63d2f0, (0xe6b9 bytes) 2024-09-14T07:12:43.563 INFO:teuthology.orchestra.run.smithi071.stdout:4117 read 0x4da9bef thru 0x4db086b (0x6c7d bytes) 2024-09-14T07:12:43.563 INFO:teuthology.orchestra.run.smithi071.stdout:4118 write 0xa9a1563 thru 0xa9a7d50 (0x67ee bytes) 2024-09-14T07:12:43.566 INFO:teuthology.orchestra.run.smithi071.stdout:4120 punch from 0x4d9f667 to 0x4da094e, (0x12e7 bytes) 2024-09-14T07:12:43.567 INFO:teuthology.orchestra.run.smithi071.stdout:4124 trunc from 0xe0ef7ed to 0xd5bb115 2024-09-14T07:12:43.573 INFO:teuthology.orchestra.run.smithi071.stdout:4125 read 0x2271d29 thru 0x227d6dd (0xb9b5 bytes) 2024-09-14T07:12:43.573 INFO:teuthology.orchestra.run.smithi071.stdout:4126 read 0x33fa16 thru 0x34750c (0x7af7 bytes) 2024-09-14T07:12:43.574 INFO:teuthology.orchestra.run.smithi071.stdout:4130 punch from 0xb6c4bb1 to 0xb6cf0bc, (0xa50b bytes) 2024-09-14T07:12:43.574 INFO:teuthology.orchestra.run.smithi071.stdout:4131 read 0xa97c018 thru 0xa986954 (0xa93d bytes) 2024-09-14T07:12:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:4135 read 0x673d7e0 thru 0x6746bf5 (0x9416 bytes) 2024-09-14T07:12:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:4136 punch from 0x85a510 to 0x866c04, (0xc6f4 bytes) 2024-09-14T07:12:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:4137 read 0x1730f73 thru 0x173dced (0xcd7b bytes) 2024-09-14T07:12:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:4138 punch from 0xbd687eb to 0xbd75d89, (0xd59e bytes) 2024-09-14T07:12:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:4139 read 0x431b238 thru 0x43204ba (0x5283 bytes) 2024-09-14T07:12:43.576 INFO:teuthology.orchestra.run.smithi071.stdout:4140 writesame 0xbf58aa5 thru 0xbf67ed1 data_size 0x1(0xf42d bytes) 2024-09-14T07:12:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:4141 read 0x8561db8 thru 0x856719e (0x53e7 bytes) 2024-09-14T07:12:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:4142 read 0x9ea701d thru 0x9eab0ae (0x4092 bytes) 2024-09-14T07:12:43.594 INFO:teuthology.orchestra.run.smithi071.stdout:4143 punch from 0x60ff217 to 0x6105806, (0x65ef bytes) 2024-09-14T07:12:43.595 INFO:teuthology.orchestra.run.smithi071.stdout:4144 trunc from 0xd5bb115 to 0xc9f7350 2024-09-14T07:12:43.601 INFO:teuthology.orchestra.run.smithi071.stdout:4145 read 0x999eeda thru 0x99a0ef0 (0x2017 bytes) 2024-09-14T07:12:43.601 INFO:teuthology.orchestra.run.smithi071.stdout:4146 writesame 0xc3feda9 thru 0xc40cd23 data_size 0x1(0xdf7b bytes) 2024-09-14T07:12:43.612 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:43.611+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:43.624 INFO:teuthology.orchestra.run.smithi071.stdout:4147 read 0x8117b01 thru 0x812378c (0xbc8c bytes) 2024-09-14T07:12:43.624 INFO:teuthology.orchestra.run.smithi071.stdout:4148 write 0x103c2c4 thru 0x103f2b4 (0x2ff1 bytes) 2024-09-14T07:12:43.626 INFO:teuthology.orchestra.run.smithi071.stdout:4150 write 0xaaf5ffd thru 0xab00b3d (0xab41 bytes) 2024-09-14T07:12:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:4151 writesame 0x1fa63e thru 0x1ff396 data_size 0x1(0x4d59 bytes) 2024-09-14T07:12:43.640 INFO:teuthology.orchestra.run.smithi071.stdout:4152 clone 30 order 25 su 16777216 sc 3 2024-09-14T07:12:43.646 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:43.646 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:43.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:43.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:12:43.743 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:43.742+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:43.803 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:43.803 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:43.803 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:43.803 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:43.803 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:43.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:43.814 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:43.813+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:43.914 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:43.914+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.922043868999999, 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:12:43.959 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:12:43.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.922018396999999, 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:12:43.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:12:43.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.922006723999999, 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:12:43.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:12:43.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921995948999999, 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:12:43.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921985408000001, 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:12:43.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:43.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:12:43.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.983 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921974939999998, 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.984 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.988 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921964427999999, 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.989 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:12:43.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.92195409, 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:43.994 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:43.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:12:43.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921943747, 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:43.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:12:44.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921925159000001, 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:12:44.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921914069, 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:12:44.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:12:44.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:12:44.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921903366999999, 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.014 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:12:44.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921882618000001, 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:44.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921856757, 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:12:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921836921000001, 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:12:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921811298000001, 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:12:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921772488999999, 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:12:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:12:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:12:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:12:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:12:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:12:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:12:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:12:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:12:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.921751820000001, 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:12:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:12:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:12:44.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:12:44.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:12:44.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:12:44.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.916390889999999, 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:12:44.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.916376335999999, 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:12:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:12:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:12:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.063 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:44.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:44.065 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:44.064+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:44.165 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:44.164+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:44.207 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:44.208 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:44.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:44.300 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:44.299+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:44.358 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:44.358 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:44.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:44.368 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:44.366+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:44.468 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:44.467+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7866 3.4 e34/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:head v 34'37, mlcod=34'34)", 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.747058432000003, 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026596739999999999, 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762239+0000", 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999995e-07 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762266+0000", 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7076e-05 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762280+0000", 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4004e-05 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762288+0000", 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.678e-06 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762339+0000", 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0430000000000003e-05 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.762357+0000", 2024-09-14T07:12:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8850000000000001e-05 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764858+0000", 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004010000000002 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.764898+0000", 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0414000000000003e-05 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.742433835, 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.741334946000002, 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.714491787, 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12482 3.0 e37/23 3:04a1ed04:::rbd_data.1182a59bd9ad.0000000000000028:head v 37'42, mlcod=37'39)", 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.42768178, 2024-09-14T07:12:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028333389999999998, 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081615+0000", 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081616+0000", 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7300000000000005e-07 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081622+0000", 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9800000000000003e-06 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081638+0000", 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6429000000000001e-05 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081646+0000", 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.622e-06 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081706+0000", 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9840000000000003e-05 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.081724+0000", 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8150000000000001e-05 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084410+0000", 2024-09-14T07:12:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026862029999999999 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.084449+0000", 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8342e-05 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.701197782000001, 2024-09-14T07:12:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.701128367999999, 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.860750342999999, 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.685159105, 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:12:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:12:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.395094209, 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:12:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:12:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:12:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:12:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:12:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.391065910999998, 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:12:44.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.170066788, 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.575 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:12:44.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:12:44.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.166548977000001, 2024-09-14T07:12:44.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:12:44.581 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.581 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.581 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:44.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:44.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:12:44.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:12:44.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.588 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:43989 3.9 e51/23 3:93226f4f:::rbd_data.1182f9393092.0000000000000076:head v 51'118, mlcod=49'115)", 2024-09-14T07:12:44.588 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:44.589 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.703597124000002, 2024-09-14T07:12:44.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029103520000000002, 2024-09-14T07:12:44.589 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.589 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.589 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:44.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:44.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805700+0000", 2024-09-14T07:12:44.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:12:44.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805706+0000", 2024-09-14T07:12:44.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3510000000000001e-06 2024-09-14T07:12:44.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805722+0000", 2024-09-14T07:12:44.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6087999999999999e-05 2024-09-14T07:12:44.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805734+0000", 2024-09-14T07:12:44.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.259e-05 2024-09-14T07:12:44.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805837+0000", 2024-09-14T07:12:44.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103168 2024-09-14T07:12:44.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.805855+0000", 2024-09-14T07:12:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8048000000000001e-05 2024-09-14T07:12:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808571+0000", 2024-09-14T07:12:44.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027152500000000002 2024-09-14T07:12:44.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.808610+0000", 2024-09-14T07:12:44.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9530000000000003e-05 2024-09-14T07:12:44.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.599 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.600 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:51334 3.4 e57/23 3:2318b1b3:::rbd_data.1182a686210f.0000000000000004:head v 57'379, mlcod=57'376)", 2024-09-14T07:12:44.600 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:44.600 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.071904469, 2024-09-14T07:12:44.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026042299999999999, 2024-09-14T07:12:44.600 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.601 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.601 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437393+0000", 2024-09-14T07:12:44.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6000000000000003e-07 2024-09-14T07:12:44.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437629+0000", 2024-09-14T07:12:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023561 2024-09-14T07:12:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437638+0000", 2024-09-14T07:12:44.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4849999999999998e-06 2024-09-14T07:12:44.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437644+0000", 2024-09-14T07:12:44.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2220000000000001e-06 2024-09-14T07:12:44.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437699+0000", 2024-09-14T07:12:44.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5603000000000003e-05 2024-09-14T07:12:44.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.437720+0000", 2024-09-14T07:12:44.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0948e-05 2024-09-14T07:12:44.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.439965+0000", 2024-09-14T07:12:44.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022452449999999999 2024-09-14T07:12:44.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:29.439997+0000", 2024-09-14T07:12:44.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1356999999999998e-05 2024-09-14T07:12:44.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:64017 3.9 e62/23 3:908553b6:::rbd_data.1182eddd9afc.0000000000000097:head v 62'186, mlcod=61'183)", 2024-09-14T07:12:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:35.990388+0000", 2024-09-14T07:12:44.611 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5189092110000004, 2024-09-14T07:12:44.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027232200000000002, 2024-09-14T07:12:44.612 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.613 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.613 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990388+0000", 2024-09-14T07:12:44.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990388+0000", 2024-09-14T07:12:44.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990389+0000", 2024-09-14T07:12:44.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9999999999999996e-07 2024-09-14T07:12:44.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990395+0000", 2024-09-14T07:12:44.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9959999999999999e-06 2024-09-14T07:12:44.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990407+0000", 2024-09-14T07:12:44.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.182e-05 2024-09-14T07:12:44.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990416+0000", 2024-09-14T07:12:44.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7059999999999999e-06 2024-09-14T07:12:44.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990466+0000", 2024-09-14T07:12:44.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9419999999999998e-05 2024-09-14T07:12:44.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.990486+0000", 2024-09-14T07:12:44.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0869999999999998e-05 2024-09-14T07:12:44.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.993071+0000", 2024-09-14T07:12:44.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002584945 2024-09-14T07:12:44.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:35.993111+0000", 2024-09-14T07:12:44.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9563000000000001e-05 2024-09-14T07:12:44.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.622 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:71337 3.9 e64/23 3:9465e89a:::rbd_data.118266971d4e.0000000000000124:head v 64'216, mlcod=63'214)", 2024-09-14T07:12:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1651702640000003, 2024-09-14T07:12:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003270069, 2024-09-14T07:12:44.623 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.624 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:44.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344128+0000", 2024-09-14T07:12:44.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8999999999999995e-07 2024-09-14T07:12:44.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344145+0000", 2024-09-14T07:12:44.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7317999999999999e-05 2024-09-14T07:12:44.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344156+0000", 2024-09-14T07:12:44.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1374e-05 2024-09-14T07:12:44.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344163+0000", 2024-09-14T07:12:44.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3169999999999998e-06 2024-09-14T07:12:44.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344209+0000", 2024-09-14T07:12:44.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6301999999999998e-05 2024-09-14T07:12:44.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344224+0000", 2024-09-14T07:12:44.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5418999999999999e-05 2024-09-14T07:12:44.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347364+0000", 2024-09-14T07:12:44.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031395490000000002 2024-09-14T07:12:44.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347397+0000", 2024-09-14T07:12:44.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.29e-05 2024-09-14T07:12:44.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.634 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:74718 3.4 e65/23 3:2087a8ac:::rbd_data.118266971d4e.0000000000000034:head v 65'444, mlcod=64'442)", 2024-09-14T07:12:44.634 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.172151+0000", 2024-09-14T07:12:44.634 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3371455619999999, 2024-09-14T07:12:44.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023282379999999998, 2024-09-14T07:12:44.634 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.635 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.635 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.635 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172151+0000", 2024-09-14T07:12:44.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172151+0000", 2024-09-14T07:12:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172153+0000", 2024-09-14T07:12:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.646e-06 2024-09-14T07:12:44.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172437+0000", 2024-09-14T07:12:44.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028349899999999999 2024-09-14T07:12:44.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172456+0000", 2024-09-14T07:12:44.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9681e-05 2024-09-14T07:12:44.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172466+0000", 2024-09-14T07:12:44.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7389999999999994e-06 2024-09-14T07:12:44.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172525+0000", 2024-09-14T07:12:44.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8904999999999999e-05 2024-09-14T07:12:44.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.172547+0000", 2024-09-14T07:12:44.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2515999999999999e-05 2024-09-14T07:12:44.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.174439+0000", 2024-09-14T07:12:44.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001891623 2024-09-14T07:12:44.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.174480+0000", 2024-09-14T07:12:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629e-05 2024-09-14T07:12:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:12:44.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:44.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6964099969999999, 2024-09-14T07:12:44.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:12:44.645 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.646 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.646 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:44.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:44.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:12:44.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:12:44.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:12:44.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:12:44.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:12:44.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:12:44.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:12:44.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:12:44.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:12:44.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:12:44.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:12:44.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:12:44.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:12:44.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:12:44.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:12:44.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:12:44.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.656 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:12:44.656 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:44.656 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.044046657, 2024-09-14T07:12:44.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:12:44.657 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:44.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:44.657 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:44.657 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:44.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:44.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:44.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:44.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:12:44.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:44.662 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:44.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:44.664 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:12:44.664 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:44.662+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:44.764 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:44.763+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:44.773 INFO:teuthology.orchestra.run.smithi071.stdout:leaving image image_client.0-clone29 intact 2024-09-14T07:12:44.815 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:44.816 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:44.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:44.868 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:44.867+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:44.965 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:44.965+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:44.971 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-14T07:12:44.973 INFO:teuthology.orchestra.run.smithi071.stdout:4153 punch from 0x12e94ee to 0x12f3e33, (0xa945 bytes) 2024-09-14T07:12:44.975 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:44.975 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:44.975 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:44.975 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:44.975 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:44.976 INFO:teuthology.orchestra.run.smithi071.stdout:4154 punch from 0x3db04f6 to 0x3dbbed1, (0xb9db bytes) 2024-09-14T07:12:44.976 INFO:teuthology.orchestra.run.smithi071.stdout:4156 read 0x15a7672 thru 0x15aea31 (0x73c0 bytes) 2024-09-14T07:12:44.982 INFO:teuthology.orchestra.run.smithi071.stdout:4157 trunc from 0xc9f7350 to 0x7cb448f 2024-09-14T07:12:44.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:44.992 INFO:teuthology.orchestra.run.smithi071.stdout:4159 write 0xf6f55b thru 0xf78fc6 (0x9a6c bytes) 2024-09-14T07:12:45.066 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:45.066+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:45.083 INFO:teuthology.orchestra.run.smithi071.stdout:4160 read 0x59e4906 thru 0x59eee34 (0xa52f bytes) 2024-09-14T07:12:45.083 INFO:teuthology.orchestra.run.smithi071.stdout:4161 read 0x2a6fa7d thru 0x2a762b9 (0x683d bytes) 2024-09-14T07:12:45.084 INFO:teuthology.orchestra.run.smithi071.stdout:4162 write 0x607b12b thru 0x6081628 (0x64fe bytes) 2024-09-14T07:12:45.085 INFO:teuthology.orchestra.run.smithi071.stdout:4164 read 0x7b32933 thru 0x7b329f8 (0xc6 bytes) 2024-09-14T07:12:45.086 INFO:teuthology.orchestra.run.smithi071.stdout:4165 read 0xe4b080 thru 0xe5265b (0x75dc bytes) 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129312581000001, 2024-09-14T07:12:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:12:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129280228999999, 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:12:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:12:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129195578000001, 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:12:45.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129170218999999, 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:12:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129137511, 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:12:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:12:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129105386999999, 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:12:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129073969, 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:12:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129049999999999, 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:12:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129030302, 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:12:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129016360000001, 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:12:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.129005129999999, 2024-09-14T07:12:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:12:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:12:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:12:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128994001999999, 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:12:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128982839999999, 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128972129000001, 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:12:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128962422000001, 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:12:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128952858000002, 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128943522, 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128933329999999, 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:12:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:12:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:12:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128912953, 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:12:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.128866908999999, 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:45.198 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:45.199 INFO:teuthology.orchestra.run.smithi071.stdout:4166 write 0xd2075f7 thru 0xd215cab (0xe6b5 bytes) 2024-09-14T07:12:45.199 INFO:teuthology.orchestra.run.smithi071.stdout:4167 write 0x36e57bd thru 0x36ee97f (0x91c3 bytes) 2024-09-14T07:12:45.199 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.199 INFO:teuthology.orchestra.run.smithi071.stdout:4169 read 0xb9161ef thru 0xb9243b4 (0xe1c6 bytes) 2024-09-14T07:12:45.199 INFO:teuthology.orchestra.run.smithi071.stdout:4170 write 0xc885ca4 thru 0xc88c52f (0x688c bytes) 2024-09-14T07:12:45.199 INFO:teuthology.orchestra.run.smithi071.stdout:4171 writesame 0x81b38c8 thru 0x81be17a data_size 0x1(0xa8b3 bytes) 2024-09-14T07:12:45.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:45.201 INFO:teuthology.orchestra.run.smithi071.stdout:4172 punch from 0x7a1ad8f to 0x7a1b4b3, (0x724 bytes) 2024-09-14T07:12:45.201 INFO:teuthology.orchestra.run.smithi071.stdout:4173 write 0x31adda1 thru 0x31ade24 (0x84 bytes) 2024-09-14T07:12:45.201 INFO:teuthology.orchestra.run.smithi071.stdout:4174 writesame 0x1558fab thru 0x15625c0 data_size 0x1(0x9616 bytes) 2024-09-14T07:12:45.202 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:45.201+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:45.223 INFO:teuthology.orchestra.run.smithi071.stdout:4175 read 0x8b03d7a thru 0x8b09326 (0x55ad bytes) 2024-09-14T07:12:45.231 INFO:teuthology.orchestra.run.smithi071.stdout:4176 trunc from 0xd215cac to 0x6dbfe83 2024-09-14T07:12:45.251 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.252 INFO:teuthology.orchestra.run.smithi071.stdout:4178 punch from 0x2a5f03f to 0x2a5fd8f, (0xd50 bytes) 2024-09-14T07:12:45.252 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.252 INFO:teuthology.orchestra.run.smithi071.stdout:4180 read 0x6dac18 thru 0x6e49a5 (0x9d8e bytes) 2024-09-14T07:12:45.252 INFO:teuthology.orchestra.run.smithi071.stdout:4181 punch from 0x478da2a to 0x478e7f0, (0xdc6 bytes) 2024-09-14T07:12:45.255 INFO:teuthology.orchestra.run.smithi071.stdout:4183 trunc from 0x6dbfe83 to 0x98a6f81 2024-09-14T07:12:45.266 INFO:teuthology.orchestra.run.smithi071.stdout:4185 writesame 0x9cf8745 thru 0x9cfa8c3 data_size 0x19(0x217f bytes) 2024-09-14T07:12:45.267 INFO:teuthology.orchestra.run.smithi071.stdout:4186 writesame 0x1a1243d thru 0x1a1c52e data_size 0x1b(0xa0f2 bytes) 2024-09-14T07:12:45.270 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.270 INFO:teuthology.orchestra.run.smithi071.stdout:4189 punch from 0x27a926d to 0x27b71b5, (0xdf48 bytes) 2024-09-14T07:12:45.270 INFO:teuthology.orchestra.run.smithi071.stdout:4190 read 0x13da1ed thru 0x13e409e (0x9eb2 bytes) 2024-09-14T07:12:45.271 INFO:teuthology.orchestra.run.smithi071.stdout:4191 write 0x3aff05f thru 0x3b0bc53 (0xcbf5 bytes) 2024-09-14T07:12:45.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:45.274 INFO:teuthology.orchestra.run.smithi071.stdout:4192 read 0x1fa913d thru 0x1fac171 (0x3035 bytes) 2024-09-14T07:12:45.274 INFO:teuthology.orchestra.run.smithi071.stdout:4193 read 0x5cb19f0 thru 0x5cc16fa (0xfd0b bytes) 2024-09-14T07:12:45.274 INFO:teuthology.orchestra.run.smithi071.stdout:4194 write 0x1e6e3ed thru 0x1e71f42 (0x3b56 bytes) 2024-09-14T07:12:45.275 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.275 INFO:teuthology.orchestra.run.smithi071.stdout:4200 read 0x7d4eae thru 0x7e46b2 (0xf805 bytes) 2024-09-14T07:12:45.283 INFO:teuthology.orchestra.run.smithi071.stdout:4201 write 0xb60d6d6 thru 0xb61bd48 (0xe673 bytes) 2024-09-14T07:12:45.286 INFO:teuthology.orchestra.run.smithi071.stdout:4202 trunc from 0xb61bd49 to 0xb1c44cd 2024-09-14T07:12:45.292 INFO:teuthology.orchestra.run.smithi071.stdout:4203 writesame 0x44285d5 thru 0x442dc19 data_size 0x7(0x5645 bytes) 2024-09-14T07:12:45.294 INFO:teuthology.orchestra.run.smithi071.stdout:4204 write 0x54bc0f1 thru 0x54c4e3b (0x8d4b bytes) 2024-09-14T07:12:45.303 INFO:teuthology.orchestra.run.smithi071.stdout:4205 trunc from 0xb1c44cd to 0x7022332 2024-09-14T07:12:45.304 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:45.302+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:45.308 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:45.308 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:45.308 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:45.308 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:45.312 INFO:teuthology.orchestra.run.smithi071.stdout:4206 read 0x55eb0c3 thru 0x55ebc65 (0xba3 bytes) 2024-09-14T07:12:45.312 INFO:teuthology.orchestra.run.smithi071.stdout:4207 write 0x3d22d01 thru 0x3d2debd (0xb1bd bytes) 2024-09-14T07:12:45.314 INFO:teuthology.orchestra.run.smithi071.stdout:4208 writesame 0x24dd56 thru 0x250f17 data_size 0x6(0x31c2 bytes) 2024-09-14T07:12:45.317 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:45.318 INFO:teuthology.orchestra.run.smithi071.stdout:4209 read 0x273206c thru 0x2739497 (0x742c bytes) 2024-09-14T07:12:45.322 INFO:teuthology.orchestra.run.smithi071.stdout:4212 write 0x701c1b3 thru 0x70264d5 (0xa323 bytes) 2024-09-14T07:12:45.325 INFO:teuthology.orchestra.run.smithi071.stdout:4213 punch from 0xf537e2 to 0xf635f7, (0xfe15 bytes) 2024-09-14T07:12:45.334 INFO:teuthology.orchestra.run.smithi071.stdout:4214 writesame 0xa9dfade thru 0xa9eecde data_size 0x3(0xf201 bytes) 2024-09-14T07:12:45.336 INFO:teuthology.orchestra.run.smithi071.stdout:4215 write 0xa0b5c97 thru 0xa0c0701 (0xaa6b bytes) 2024-09-14T07:12:45.339 INFO:teuthology.orchestra.run.smithi071.stdout:4216 trunc from 0xa9eecdf to 0x87f0abf 2024-09-14T07:12:45.346 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.346 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.350 INFO:teuthology.orchestra.run.smithi071.stdout:4219 trunc from 0x87f0abf to 0x5928ca6 2024-09-14T07:12:45.360 INFO:teuthology.orchestra.run.smithi071.stdout:4220 read 0x1d9ee03 thru 0x1da2e76 (0x4074 bytes) 2024-09-14T07:12:45.360 INFO:teuthology.orchestra.run.smithi071.stdout:4221 read 0x407066e thru 0x4072d47 (0x26da bytes) 2024-09-14T07:12:45.376 INFO:teuthology.orchestra.run.smithi071.stdout:4222 writesame 0xbd0f1b3 thru 0xbd14721 data_size 0x1(0x556f bytes) 2024-09-14T07:12:45.377 INFO:teuthology.orchestra.run.smithi071.stdout:4224 write 0xaaa4238 thru 0xaaa7b11 (0x38da bytes) 2024-09-14T07:12:45.377 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.378 INFO:teuthology.orchestra.run.smithi071.stdout:4226 write 0x3185724 thru 0x318fdb9 (0xa696 bytes) 2024-09-14T07:12:45.379 INFO:teuthology.orchestra.run.smithi071.stdout:4227 writesame 0x31a1718 thru 0x31acd93 data_size 0x44(0xb67c bytes) 2024-09-14T07:12:45.381 INFO:teuthology.orchestra.run.smithi071.stdout:4228 punch from 0x45b4364 to 0x45bb9d3, (0x766f bytes) 2024-09-14T07:12:45.381 INFO:teuthology.orchestra.run.smithi071.stdout:4230 write 0x714a50d thru 0x714eb52 (0x4646 bytes) 2024-09-14T07:12:45.384 INFO:teuthology.orchestra.run.smithi071.stdout:4231 writesame 0x31c9998 thru 0x31d2ea6 data_size 0x1(0x950f bytes) 2024-09-14T07:12:45.404 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:45.403+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:45.405 INFO:teuthology.orchestra.run.smithi071.stdout:4232 write 0x1eb4893 thru 0x1ec31ba (0xe928 bytes) 2024-09-14T07:12:45.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:45.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:45.414 INFO:teuthology.orchestra.run.smithi071.stdout:4233 writesame 0xda39589 thru 0xda3db9d data_size 0xb(0x4615 bytes) 2024-09-14T07:12:45.414 INFO:teuthology.orchestra.run.smithi071.stdout:4234 read 0x276f005 thru 0x277a71c (0xb718 bytes) 2024-09-14T07:12:45.414 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.419 INFO:teuthology.orchestra.run.smithi071.stdout:4239 write 0xda3f96d thru 0xda4d3d3 (0xda67 bytes) 2024-09-14T07:12:45.421 INFO:teuthology.orchestra.run.smithi071.stdout:4242 read 0x801eaf thru 0x804de3 (0x2f35 bytes) 2024-09-14T07:12:45.422 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.422 INFO:teuthology.orchestra.run.smithi071.stdout:4246 write 0xff46dd thru 0xffeec3 (0xa7e7 bytes) 2024-09-14T07:12:45.424 INFO:teuthology.orchestra.run.smithi071.stdout:4248 punch from 0x339bd63 to 0x339c05d, (0x2fa bytes) 2024-09-14T07:12:45.424 INFO:teuthology.orchestra.run.smithi071.stdout:4249 read 0x6cc2bd6 thru 0x6ccb48b (0x88b6 bytes) 2024-09-14T07:12:45.424 INFO:teuthology.orchestra.run.smithi071.stdout:4250 writesame 0x47c77eb thru 0x47d2925 data_size 0x1(0xb13b bytes) 2024-09-14T07:12:45.426 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:45.426 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:45.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:45.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:45.443 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:45.447 INFO:teuthology.orchestra.run.smithi071.stdout:4252 writesame 0xd35aed6 thru 0xd368f78 data_size 0x1d(0xe0a3 bytes) 2024-09-14T07:12:45.449 INFO:teuthology.orchestra.run.smithi071.stdout:4253 punch from 0x946bda to 0x949681, (0x2aa7 bytes) 2024-09-14T07:12:45.455 INFO:teuthology.orchestra.run.smithi071.stdout:4255 trunc from 0xda4d3d4 to 0x861517b 2024-09-14T07:12:45.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:45.475 INFO:teuthology.orchestra.run.smithi071.stdout:4257 writesame 0xcbbfeb1 thru 0xcbc20d9 data_size 0xf(0x2229 bytes) 2024-09-14T07:12:45.475 INFO:teuthology.orchestra.run.smithi071.stdout:4259 write 0x200b9af thru 0x200fb5f (0x41b1 bytes) 2024-09-14T07:12:45.476 INFO:teuthology.orchestra.run.smithi071.stdout:4260 writesame 0x8b148ad thru 0x8b16f25 data_size 0x31(0x2679 bytes) 2024-09-14T07:12:45.479 INFO:teuthology.orchestra.run.smithi071.stdout:4261 write 0xbaece2d thru 0xbaf99b5 (0xcb89 bytes) 2024-09-14T07:12:45.480 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:45.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:45.480 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:45.481 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.481 INFO:teuthology.orchestra.run.smithi071.stdout:4265 read 0x6b6a3f7 thru 0x6b6b91f (0x1529 bytes) 2024-09-14T07:12:45.485 INFO:teuthology.orchestra.run.smithi071.stdout:4268 writesame 0xcc91367 thru 0xcc9b2c4 data_size 0x1(0x9f5e bytes) 2024-09-14T07:12:45.485 INFO:teuthology.orchestra.run.smithi071.stdout:4269 read 0x73d1c25 thru 0x73dfe7d (0xe259 bytes) 2024-09-14T07:12:45.486 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.486 INFO:teuthology.orchestra.run.smithi071.stdout:4272 read 0xbf0522e thru 0xbf0ef53 (0x9d26 bytes) 2024-09-14T07:12:45.486 INFO:teuthology.orchestra.run.smithi071.stdout:4273 read 0x8c28447 thru 0x8c323c7 (0x9f81 bytes) 2024-09-14T07:12:45.486 INFO:teuthology.orchestra.run.smithi071.stdout:4274 write 0x105f061 thru 0x1068543 (0x94e3 bytes) 2024-09-14T07:12:45.488 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.488 INFO:teuthology.orchestra.run.smithi071.stdout:4276 read 0x6afb491 thru 0x6b03f93 (0x8b03 bytes) 2024-09-14T07:12:45.488 INFO:teuthology.orchestra.run.smithi071.stdout:4277 write 0x676d39 thru 0x67ba6d (0x4d35 bytes) 2024-09-14T07:12:45.490 INFO:teuthology.orchestra.run.smithi071.stdout:4279 punch from 0xe4bc45 to 0xe52f60, (0x731b bytes) 2024-09-14T07:12:45.490 INFO:teuthology.orchestra.run.smithi071.stdout:4282 read 0x14d2569 thru 0x14d9c39 (0x76d1 bytes) 2024-09-14T07:12:45.491 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.498 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:45.498 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:45.499 INFO:teuthology.orchestra.run.smithi071.stdout:4284 trunc from 0xcc9b2c5 to 0x5d80f28 2024-09-14T07:12:45.510 INFO:teuthology.orchestra.run.smithi071.stdout:4285 write 0x32c17b thru 0x330ceb (0x4b71 bytes) 2024-09-14T07:12:45.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:45.519 INFO:teuthology.orchestra.run.smithi071.stdout:4286 write 0x7655898 thru 0x765ffdd (0xa746 bytes) 2024-09-14T07:12:45.520 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:45.520 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:45.521 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:45.521+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:45.522 INFO:teuthology.orchestra.run.smithi071.stdout:4287 trunc from 0x765ffde to 0x7ad2775 2024-09-14T07:12:45.526 INFO:teuthology.orchestra.run.smithi071.stdout:4288 write 0x71bc311 thru 0x71bf81a (0x350a bytes) 2024-09-14T07:12:45.527 INFO:teuthology.orchestra.run.smithi071.stdout:4290 read 0x2810ef9 thru 0x28111c1 (0x2c9 bytes) 2024-09-14T07:12:45.528 INFO:teuthology.orchestra.run.smithi071.stdout:4291 punch from 0x75e7228 to 0x75f0fe3, (0x9dbb bytes) 2024-09-14T07:12:45.528 INFO:teuthology.orchestra.run.smithi071.stdout:4292 read 0x49f5dbc thru 0x4a00190 (0xa3d5 bytes) 2024-09-14T07:12:45.528 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.528 INFO:teuthology.orchestra.run.smithi071.stdout:4294 punch from 0x66d8e47 to 0x66e667e, (0xd837 bytes) 2024-09-14T07:12:45.532 INFO:teuthology.orchestra.run.smithi071.stdout:4296 trunc from 0x7ad2775 to 0xb218120 2024-09-14T07:12:45.537 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.537 INFO:teuthology.orchestra.run.smithi071.stdout:4298 read 0xaeaa6ad thru 0xaeb130b (0x6c5f bytes) 2024-09-14T07:12:45.538 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.538 INFO:teuthology.orchestra.run.smithi071.stdout:4301 read 0x81bcc05 thru 0x81beea9 (0x22a5 bytes) 2024-09-14T07:12:45.545 INFO:teuthology.orchestra.run.smithi071.stdout:4303 write 0xd4ef703 thru 0xd4f9e0b (0xa709 bytes) 2024-09-14T07:12:45.547 INFO:teuthology.orchestra.run.smithi071.stdout:4304 write 0xafb7cc5 thru 0xafbb560 (0x389c bytes) 2024-09-14T07:12:45.557 INFO:teuthology.orchestra.run.smithi071.stdout:4305 trunc from 0xd4f9e0c to 0x6c14e94 2024-09-14T07:12:45.571 INFO:teuthology.orchestra.run.smithi071.stdout:4306 trunc from 0x6c14e94 to 0x410624c 2024-09-14T07:12:45.577 INFO:teuthology.orchestra.run.smithi071.stdout:4307 read 0x149eaac thru 0x14a100a (0x255f bytes) 2024-09-14T07:12:45.580 INFO:teuthology.orchestra.run.smithi071.stdout:4308 punch from 0x953a71 to 0x95ed59, (0xb2e8 bytes) 2024-09-14T07:12:45.580 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.585 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:45.585 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:45.590 INFO:teuthology.orchestra.run.smithi071.stdout:4310 write 0xa506723 thru 0xa513e88 (0xd766 bytes) 2024-09-14T07:12:45.593 INFO:teuthology.orchestra.run.smithi071.stdout:4312 punch from 0x9d2fad4 to 0x9d3f537, (0xfa63 bytes) 2024-09-14T07:12:45.593 INFO:teuthology.orchestra.run.smithi071.stdout:4313 write 0x97ae81a thru 0x97b4cb6 (0x649d bytes) 2024-09-14T07:12:45.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:45.595 INFO:teuthology.orchestra.run.smithi071.stdout:4314 punch from 0x3ac77b7 to 0x3ad44ef, (0xcd38 bytes) 2024-09-14T07:12:45.599 INFO:teuthology.orchestra.run.smithi071.stdout:4315 trunc from 0xa513e89 to 0x7835579 2024-09-14T07:12:45.604 INFO:teuthology.orchestra.run.smithi071.stdout:4317 read 0x4f39164 thru 0x4f3e038 (0x4ed5 bytes) 2024-09-14T07:12:45.607 INFO:teuthology.orchestra.run.smithi071.stdout:4318 trunc from 0x7835579 to 0x587ddf0 2024-09-14T07:12:45.616 INFO:teuthology.orchestra.run.smithi071.stdout:4319 write 0x3c8c0a3 thru 0x3c9ae4c (0xedaa bytes) 2024-09-14T07:12:45.618 INFO:teuthology.orchestra.run.smithi071.stdout:4320 write 0xc0f361 thru 0xc1a1cd (0xae6d bytes) 2024-09-14T07:12:45.636 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:45.635+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:45.636 INFO:teuthology.orchestra.run.smithi071.stdout:4324 write 0xebae468 thru 0xebbcf02 (0xea9b bytes) 2024-09-14T07:12:45.638 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.639 INFO:teuthology.orchestra.run.smithi071.stdout:4327 read 0x51ebfc3 thru 0x51f4141 (0x817f bytes) 2024-09-14T07:12:45.643 INFO:teuthology.orchestra.run.smithi071.stdout:4328 trunc from 0xebbcf03 to 0xb88fbea 2024-09-14T07:12:45.660 INFO:teuthology.orchestra.run.smithi071.stdout:4329 write 0xecacb16 thru 0xecb27dc (0x5cc7 bytes) 2024-09-14T07:12:45.663 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.663 INFO:teuthology.orchestra.run.smithi071.stdout:4331 write 0xb5887f thru 0xb5a0b2 (0x1834 bytes) 2024-09-14T07:12:45.664 INFO:teuthology.orchestra.run.smithi071.stdout:4332 read 0xe29c741 thru 0xe2a562f (0x8eef bytes) 2024-09-14T07:12:45.665 INFO:teuthology.orchestra.run.smithi071.stdout:4333 write 0x6fb7c02 thru 0x6fb8178 (0x577 bytes) 2024-09-14T07:12:45.667 INFO:teuthology.orchestra.run.smithi071.stdout:4336 read 0x217eb2f thru 0x2183285 (0x4757 bytes) 2024-09-14T07:12:45.667 INFO:teuthology.orchestra.run.smithi071.stdout:4338 write 0xea861a thru 0xeae6ba (0x60a1 bytes) 2024-09-14T07:12:45.669 INFO:teuthology.orchestra.run.smithi071.stdout:4339 write 0xbced112 thru 0xbcf67ee (0x96dd bytes) 2024-09-14T07:12:45.672 INFO:teuthology.orchestra.run.smithi071.stdout:4341 write 0x9cd1cbc thru 0x9cd9f5b (0x82a0 bytes) 2024-09-14T07:12:45.673 INFO:teuthology.orchestra.run.smithi071.stdout:4343 write 0xb9f3631 thru 0xb9f3e8d (0x85d bytes) 2024-09-14T07:12:45.674 INFO:teuthology.orchestra.run.smithi071.stdout:4344 writesame 0xafcc9b7 thru 0xafd8257 data_size 0x5(0xb8a1 bytes) 2024-09-14T07:12:45.680 INFO:teuthology.orchestra.run.smithi071.stdout:4345 punch from 0xe67e59c to 0xe687554, (0x8fb8 bytes) 2024-09-14T07:12:45.692 INFO:teuthology.orchestra.run.smithi071.stdout:4347 trunc from 0xecb27dd to 0x4e1a2b6 2024-09-14T07:12:45.702 INFO:teuthology.orchestra.run.smithi071.stdout:4349 write 0x3b409ed thru 0x3b44347 (0x395b bytes) 2024-09-14T07:12:45.703 INFO:teuthology.orchestra.run.smithi071.stdout:4350 read 0x11091fb thru 0x11115d0 (0x83d6 bytes) 2024-09-14T07:12:45.704 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.704 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.704 INFO:teuthology.orchestra.run.smithi071.stdout:4356 read 0x37b953f thru 0x37b9a3b (0x4fd bytes) 2024-09-14T07:12:45.705 INFO:teuthology.orchestra.run.smithi071.stdout:4358 flatten 2024-09-14T07:12:45.706 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:45.705+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:45.711 INFO:teuthology.orchestra.run.smithi071.stdout:4360 read 0x1a30962 thru 0x1a30f22 (0x5c1 bytes) 2024-09-14T07:12:45.712 INFO:teuthology.orchestra.run.smithi071.stdout:4361 read 0x4d266d5 thru 0x4d2c54b (0x5e77 bytes) 2024-09-14T07:12:45.713 INFO:teuthology.orchestra.run.smithi071.stdout:4363 read 0x4b27d14 thru 0x4b37896 (0xfb83 bytes) 2024-09-14T07:12:45.713 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.713 INFO:teuthology.orchestra.run.smithi071.stdout:4368 writesame 0x1cc962 thru 0x1cf04c data_size 0x29(0x26eb bytes) 2024-09-14T07:12:45.721 INFO:teuthology.orchestra.run.smithi071.stdout:4369 write 0x5c6046d thru 0x5c69d83 (0x9917 bytes) 2024-09-14T07:12:45.722 INFO:teuthology.orchestra.run.smithi071.stdout:4370 write 0x16bf2d5 thru 0x16bfaa2 (0x7ce bytes) 2024-09-14T07:12:45.735 INFO:teuthology.orchestra.run.smithi071.stdout:4372 write 0xb221fbd thru 0xb228d4b (0x6d8f bytes) 2024-09-14T07:12:45.738 INFO:teuthology.orchestra.run.smithi071.stdout:4373 write 0x1267c3f thru 0x1273143 (0xb505 bytes) 2024-09-14T07:12:45.739 INFO:teuthology.orchestra.run.smithi071.stdout:4374 write 0x5eb59f1 thru 0x5ec2ba9 (0xd1b9 bytes) 2024-09-14T07:12:45.741 INFO:teuthology.orchestra.run.smithi071.stdout:4380 write 0x49f5361 thru 0x49fbf6e (0x6c0e bytes) 2024-09-14T07:12:45.743 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:45.743 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:45.751 INFO:teuthology.orchestra.run.smithi071.stdout:4381 write 0xe451b32 thru 0xe456527 (0x49f6 bytes) 2024-09-14T07:12:45.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:45.753 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.754 INFO:teuthology.orchestra.run.smithi071.stdout:4383 write 0x5204135 thru 0x5209082 (0x4f4e bytes) 2024-09-14T07:12:45.754 INFO:teuthology.orchestra.run.smithi071.stdout:4388 write 0x747b285 thru 0x747d342 (0x20be bytes) 2024-09-14T07:12:45.758 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:45.759 INFO:teuthology.orchestra.run.smithi071.stdout:4390 read 0x885fbdf thru 0x8865f0e (0x6330 bytes) 2024-09-14T07:12:45.759 INFO:teuthology.orchestra.run.smithi071.stdout:4392 write 0x771863c thru 0x771faeb (0x74b0 bytes) 2024-09-14T07:12:45.760 INFO:teuthology.orchestra.run.smithi071.stdout:4393 read 0x64cdec3 thru 0x64d3965 (0x5aa3 bytes) 2024-09-14T07:12:45.764 INFO:teuthology.orchestra.run.smithi071.stdout:4394 write 0xe59febe thru 0xe5a06d8 (0x81b bytes) 2024-09-14T07:12:45.765 INFO:teuthology.orchestra.run.smithi071.stdout:4395 clone 31 order 22 su 65536 sc 4 2024-09-14T07:12:45.807 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:45.806+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:45.856 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:45.856 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:45.865 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:45.909 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:45.908+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:45.925 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:45.926 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:45.926 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T07:12:45.926 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-09-14T07:12:45.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-14T07:12:45.968 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:45.968 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:45.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:46.008 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:46.007+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:46.109 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:46.109+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:46.121 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.121 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:46.211 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:46.210+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:46.232 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.233 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:46.311 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:46.311+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:46.343 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.343 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:46.413 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:46.412+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:46.455 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.455 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:46.514 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:46.513+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:46.605 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.605 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:46.615 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:46.615+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:46.655 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-14T07:12:46.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:12:46.716 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:46.716+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:46.730 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.730 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:46.818 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:46.817+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:46.893 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:46.893 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:46.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:46.904 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-14T07:12:46.949 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:46.948+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:47.019 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:47.018+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:47.023 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:47.024 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:47.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:47.120 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:47.120+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:47.148 INFO:teuthology.orchestra.run.smithi071.stdout:4396 write 0x64ad2c9 thru 0x64b3441 (0x6179 bytes) 2024-09-14T07:12:47.157 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.157 INFO:teuthology.orchestra.run.smithi071.stdout:4400 read 0x59df4 thru 0x61d02 (0x7f0f bytes) 2024-09-14T07:12:47.157 INFO:teuthology.orchestra.run.smithi071.stdout:4402 read 0x2bb0b40 thru 0x2bbc06e (0xb52f bytes) 2024-09-14T07:12:47.158 INFO:teuthology.orchestra.run.smithi071.stdout:4403 write 0x4e58274 thru 0x4e6379c (0xb529 bytes) 2024-09-14T07:12:47.178 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.179 INFO:teuthology.orchestra.run.smithi071.stdout:4406 write 0x4e907b1 thru 0x4e9e8ad (0xe0fd bytes) 2024-09-14T07:12:47.180 INFO:teuthology.orchestra.run.smithi071.stdout:4407 punch from 0xa9e365b to 0xa9ef3d0, (0xbd75 bytes) 2024-09-14T07:12:47.180 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.180 INFO:teuthology.orchestra.run.smithi071.stdout:4409 punch from 0x48190a7 to 0x48234c1, (0xa41a bytes) 2024-09-14T07:12:47.180 INFO:teuthology.orchestra.run.smithi071.stdout:4412 write 0x7718dd3 thru 0x771a693 (0x18c1 bytes) 2024-09-14T07:12:47.181 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:47.181 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:47.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:47.190 INFO:teuthology.orchestra.run.smithi071.stdout:4413 writesame 0xd532573 thru 0xd53b963 data_size 0xb(0x93f1 bytes) 2024-09-14T07:12:47.195 INFO:teuthology.orchestra.run.smithi071.stdout:4415 write 0x5248745 thru 0x524937a (0xc36 bytes) 2024-09-14T07:12:47.221 INFO:teuthology.orchestra.run.smithi071.stdout:4416 trunc from 0xe5a06d9 to 0x419574b 2024-09-14T07:12:47.222 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:47.220+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:47.267 INFO:teuthology.orchestra.run.smithi071.stdout:4418 write 0xea66aca thru 0xea69fd4 (0x350b bytes) 2024-09-14T07:12:47.271 INFO:teuthology.orchestra.run.smithi071.stdout:4420 trunc from 0xea69fd5 to 0xd3ad17e 2024-09-14T07:12:47.280 INFO:teuthology.orchestra.run.smithi071.stdout:4421 writesame 0xaa1df2e thru 0xaa29d36 data_size 0x1(0xbe09 bytes) 2024-09-14T07:12:47.301 INFO:teuthology.orchestra.run.smithi071.stdout:4423 punch from 0x4f85724 to 0x4f929d5, (0xd2b1 bytes) 2024-09-14T07:12:47.301 INFO:teuthology.orchestra.run.smithi071.stdout:4425 punch from 0xafff95e to 0xb001b91, (0x2233 bytes) 2024-09-14T07:12:47.301 INFO:teuthology.orchestra.run.smithi071.stdout:4426 read 0xa3b523a thru 0xa3c0068 (0xae2f bytes) 2024-09-14T07:12:47.301 INFO:teuthology.orchestra.run.smithi071.stdout:4427 writesame 0x1e81529 thru 0x1e8d5a7 data_size 0x1(0xc07f bytes) 2024-09-14T07:12:47.304 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:47.304 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:47.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:47.356 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:47.355+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:47.370 INFO:teuthology.orchestra.run.smithi071.stdout:4428 write 0x3d14b4d thru 0x3d1ef7c (0xa430 bytes) 2024-09-14T07:12:47.384 INFO:teuthology.orchestra.run.smithi071.stdout:4430 writesame 0x5b659a7 thru 0x5b6cc9b data_size 0x1(0x72f5 bytes) 2024-09-14T07:12:47.397 INFO:teuthology.orchestra.run.smithi071.stdout:4431 punch from 0x29f0615 to 0x29ff23c, (0xec27 bytes) 2024-09-14T07:12:47.397 INFO:teuthology.orchestra.run.smithi071.stdout:4432 writesame 0xa1d0ea2 thru 0xa1d8f77 data_size 0x45(0x80d6 bytes) 2024-09-14T07:12:47.398 INFO:teuthology.orchestra.run.smithi071.stdout:4433 read 0x106060f thru 0x106a5bd (0x9faf bytes) 2024-09-14T07:12:47.399 INFO:teuthology.orchestra.run.smithi071.stdout:4434 read 0x6a46b5c thru 0x6a52a0a (0xbeaf bytes) 2024-09-14T07:12:47.399 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.399 INFO:teuthology.orchestra.run.smithi071.stdout:4437 read 0x62a6102 thru 0x62a7e28 (0x1d27 bytes) 2024-09-14T07:12:47.403 INFO:teuthology.orchestra.run.smithi071.stdout:4438 trunc from 0xd3ad17e to 0x955f2ff 2024-09-14T07:12:47.412 INFO:teuthology.orchestra.run.smithi071.stdout:4440 read 0x34f25b0 thru 0x350258f (0xffe0 bytes) 2024-09-14T07:12:47.413 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.413 INFO:teuthology.orchestra.run.smithi071.stdout:4442 write 0x1f616eb thru 0x1f647a8 (0x30be bytes) 2024-09-14T07:12:47.422 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:47.421+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:47.457 INFO:teuthology.orchestra.run.smithi071.stdout:4443 trunc from 0x955f2ff to 0x4545fe9 2024-09-14T07:12:47.468 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:47.468 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:47.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:47.485 INFO:teuthology.orchestra.run.smithi071.stdout:4445 write 0x9c11c4d thru 0x9c181a6 (0x655a bytes) 2024-09-14T07:12:47.488 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.488 INFO:teuthology.orchestra.run.smithi071.stdout:4448 writesame 0xdf752d thru 0xe01017 data_size 0x1(0x9aeb bytes) 2024-09-14T07:12:47.521 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:47.523 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:47.522+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:47.592 INFO:teuthology.orchestra.run.smithi071.stdout:4449 trunc from 0x9c181a7 to 0xce10c43 2024-09-14T07:12:47.596 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:47.596 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:47.597 INFO:teuthology.orchestra.run.smithi071.stdout:4451 writesame 0x747547f thru 0x7484afe data_size 0x22(0xf680 bytes) 2024-09-14T07:12:47.601 INFO:teuthology.orchestra.run.smithi071.stdout:4452 punch from 0x27461ac to 0x2750c4e, (0xaaa2 bytes) 2024-09-14T07:12:47.601 INFO:teuthology.orchestra.run.smithi071.stdout:4453 read 0x22b126b thru 0x22b9b7a (0x8910 bytes) 2024-09-14T07:12:47.602 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.602 INFO:teuthology.orchestra.run.smithi071.stdout:4455 write 0x4485326 thru 0x44907fe (0xb4d9 bytes) 2024-09-14T07:12:47.604 INFO:teuthology.orchestra.run.smithi071.stdout:4457 read 0xc006c5a thru 0xc00d090 (0x6437 bytes) 2024-09-14T07:12:47.604 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.604 INFO:teuthology.orchestra.run.smithi071.stdout:4459 write 0xb8c4c71 thru 0xb8d49a9 (0xfd39 bytes) 2024-09-14T07:12:47.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:47.607 INFO:teuthology.orchestra.run.smithi071.stdout:4460 read 0x7476be0 thru 0x74790a2 (0x24c3 bytes) 2024-09-14T07:12:47.611 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.611 INFO:teuthology.orchestra.run.smithi071.stdout:4462 write 0x9c7ff42 thru 0x9c8a8b1 (0xa970 bytes) 2024-09-14T07:12:47.615 INFO:teuthology.orchestra.run.smithi071.stdout:4463 write 0x8417354 thru 0x8424dd6 (0xda83 bytes) 2024-09-14T07:12:47.618 INFO:teuthology.orchestra.run.smithi071.stdout:4464 write 0x8336944 thru 0x8341c21 (0xb2de bytes) 2024-09-14T07:12:47.624 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:47.623+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:47.629 INFO:teuthology.orchestra.run.smithi071.stdout:4465 write 0xed919c7 thru 0xed9fa32 (0xe06c bytes) 2024-09-14T07:12:47.632 INFO:teuthology.orchestra.run.smithi071.stdout:4466 write 0x122164b thru 0x1221a19 (0x3cf bytes) 2024-09-14T07:12:47.633 INFO:teuthology.orchestra.run.smithi071.stdout:4467 writesame 0xd7ce635 thru 0xd7d8908 data_size 0x11(0xa2d4 bytes) 2024-09-14T07:12:47.638 INFO:teuthology.orchestra.run.smithi071.stdout:4468 punch from 0xc609275 to 0xc6157c9, (0xc554 bytes) 2024-09-14T07:12:47.638 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.639 INFO:teuthology.orchestra.run.smithi071.stdout:4470 read 0x17ddf5 thru 0x17f7f5 (0x1a01 bytes) 2024-09-14T07:12:47.639 INFO:teuthology.orchestra.run.smithi071.stdout:4471 read 0xc76009d thru 0xc761878 (0x17dc bytes) 2024-09-14T07:12:47.639 INFO:teuthology.orchestra.run.smithi071.stdout:4472 write 0xd87272f thru 0xd87fb5c (0xd42e bytes) 2024-09-14T07:12:47.642 INFO:teuthology.orchestra.run.smithi071.stdout:4473 write 0x5391579 thru 0x539b1fe (0x9c86 bytes) 2024-09-14T07:12:47.646 INFO:teuthology.orchestra.run.smithi071.stdout:4475 read 0xa80f6dd thru 0xa812c8b (0x35af bytes) 2024-09-14T07:12:47.646 INFO:teuthology.orchestra.run.smithi071.stdout:4476 read 0xa33d164 thru 0xa33f349 (0x21e6 bytes) 2024-09-14T07:12:47.646 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:47.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:47.657 INFO:teuthology.orchestra.run.smithi071.stdout:4479 trunc from 0xed9fa33 to 0x65c368c 2024-09-14T07:12:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:12:47.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:47.679 INFO:teuthology.orchestra.run.smithi071.stdout:4481 trunc from 0x65c368c to 0x11962eb 2024-09-14T07:12:47.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:47.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:47.716 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:47.725 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:47.724+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:47.730 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:47.731 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:47.731 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:47.731 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:47.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:47.734 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:47.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:47.752 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:47.768 INFO:teuthology.orchestra.run.smithi071.stdout:4485 write 0x7471ccd thru 0x7476889 (0x4bbd bytes) 2024-09-14T07:12:47.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:47.771 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.771 INFO:teuthology.orchestra.run.smithi071.stdout:4488 punch from 0x27905c7 to 0x279c6dc, (0xc115 bytes) 2024-09-14T07:12:47.771 INFO:teuthology.orchestra.run.smithi071.stdout:4489 punch from 0x230d919 to 0x2311f1c, (0x4603 bytes) 2024-09-14T07:12:47.771 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.774 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:47.774 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:47.782 INFO:teuthology.orchestra.run.smithi071.stdout:4491 writesame 0xc249358 thru 0xc25480e data_size 0x7(0xb4b7 bytes) 2024-09-14T07:12:47.787 INFO:teuthology.orchestra.run.smithi071.stdout:4492 trunc from 0xc25480f to 0x8c6d185 2024-09-14T07:12:47.799 INFO:teuthology.orchestra.run.smithi071.stdout:4493 trunc from 0x8c6d185 to 0x29c4ea5 2024-09-14T07:12:47.810 INFO:teuthology.orchestra.run.smithi071.stdout:4494 punch from 0x1d19b3f to 0x1d1ce00, (0x32c1 bytes) 2024-09-14T07:12:47.820 INFO:teuthology.orchestra.run.smithi071.stdout:4497 trunc from 0x29c4ea5 to 0xb5cf70e 2024-09-14T07:12:47.828 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:47.826+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:47.828 INFO:teuthology.orchestra.run.smithi071.stdout:4498 read 0x6983cee thru 0x698d9ee (0x9d01 bytes) 2024-09-14T07:12:47.828 INFO:teuthology.orchestra.run.smithi071.stdout:4499 write 0x9464aa4 thru 0x946b3f1 (0x694e bytes) 2024-09-14T07:12:47.831 INFO:teuthology.orchestra.run.smithi071.stdout:4500 write 0x3ba1689 thru 0x3ba42a8 (0x2c20 bytes) 2024-09-14T07:12:47.835 INFO:teuthology.orchestra.run.smithi071.stdout:4501 write 0x296b779 thru 0x2970f54 (0x57dc bytes) 2024-09-14T07:12:47.841 INFO:teuthology.orchestra.run.smithi071.stdout:4502 read 0x4faf610 thru 0x4fb0136 (0xb27 bytes) 2024-09-14T07:12:47.841 INFO:teuthology.orchestra.run.smithi071.stdout:4503 punch from 0x3e08ea5 to 0x3e1702a, (0xe185 bytes) 2024-09-14T07:12:47.841 INFO:teuthology.orchestra.run.smithi071.stdout:4504 read 0x65ac0c thru 0x65c98a (0x1d7f bytes) 2024-09-14T07:12:47.847 INFO:teuthology.orchestra.run.smithi071.stdout:4506 trunc from 0xb5cf70e to 0x676a4f4 2024-09-14T07:12:47.862 INFO:teuthology.orchestra.run.smithi071.stdout:4507 punch from 0x112faef to 0x113e9a2, (0xeeb3 bytes) 2024-09-14T07:12:47.869 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:47.869 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:47.869 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:47.869 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:47.869 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:47.872 INFO:teuthology.orchestra.run.smithi071.stdout:4508 write 0x8abbb6a thru 0x8ac9605 (0xda9c bytes) 2024-09-14T07:12:47.876 INFO:teuthology.orchestra.run.smithi071.stdout:4509 read 0x6eec7a1 thru 0x6eec949 (0x1a9 bytes) 2024-09-14T07:12:47.876 INFO:teuthology.orchestra.run.smithi071.stdout:4510 punch from 0x7e1bc92 to 0x7e1e882, (0x2bf0 bytes) 2024-09-14T07:12:47.877 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.877 INFO:teuthology.orchestra.run.smithi071.stdout:4512 write 0x2896af thru 0x28dbac (0x44fe bytes) 2024-09-14T07:12:47.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:4513 read 0x297c240 thru 0x2985c2b (0x99ec bytes) 2024-09-14T07:12:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:4514 read 0x6797ab4 thru 0x679f6ce (0x7c1b bytes) 2024-09-14T07:12:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:4518 read 0x637aa26 thru 0x637faf5 (0x50d0 bytes) 2024-09-14T07:12:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:4519 read 0x1f15f11 thru 0x1f19885 (0x3975 bytes) 2024-09-14T07:12:47.887 INFO:teuthology.orchestra.run.smithi071.stdout:4520 write 0xc3ce258 thru 0xc3d4c7a (0x6a23 bytes) 2024-09-14T07:12:47.891 INFO:teuthology.orchestra.run.smithi071.stdout:4522 read 0x5cb1277 thru 0x5cb68c0 (0x564a bytes) 2024-09-14T07:12:47.891 INFO:teuthology.orchestra.run.smithi071.stdout:4523 read 0x5900008 thru 0x59053df (0x53d8 bytes) 2024-09-14T07:12:47.896 INFO:teuthology.orchestra.run.smithi071.stdout:4524 trunc from 0xc3d4c7b to 0x8004bc1 2024-09-14T07:12:47.908 INFO:teuthology.orchestra.run.smithi071.stdout:4527 punch from 0xc43932 to 0xc5369b, (0xfd69 bytes) 2024-09-14T07:12:47.919 INFO:teuthology.orchestra.run.smithi071.stdout:4529 write 0xd3e8068 thru 0xd3ee386 (0x631f bytes) 2024-09-14T07:12:47.928 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:47.927+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:47.931 INFO:teuthology.orchestra.run.smithi071.stdout:4530 trunc from 0xd3ee387 to 0x5ee2c26 2024-09-14T07:12:47.942 INFO:teuthology.orchestra.run.smithi071.stdout:4531 read 0x5b16fa4 thru 0x5b23b26 (0xcb83 bytes) 2024-09-14T07:12:47.942 INFO:teuthology.orchestra.run.smithi071.stdout:4532 punch from 0xddfb9f to 0xde9cff, (0xa160 bytes) 2024-09-14T07:12:47.942 INFO:teuthology.orchestra.run.smithi071.stdout:4533 clone 32 order 22 su 262144 sc 15 2024-09-14T07:12:47.988 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.018053365, 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:47.989 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:12:47.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:47.993 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.018021012999998, 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:47.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:47.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:47.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:47.998 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017936362, 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:47.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:48.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:48.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017911002999998, 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:12:48.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017878294999999, 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:48.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:12:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:12:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017846170999999, 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:12:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017814753, 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:12:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017790783999999, 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:12:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017771086, 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017757144000001, 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:12:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017745913999999, 2024-09-14T07:12:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:48.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:12:48.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:12:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017734785999998, 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:48.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017723623999998, 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:12:48.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017712913, 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:12:48.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017703206, 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:12:48.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:12:48.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017693642000001, 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:12:48.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:12:48.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.063 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017684306, 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:12:48.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:12:48.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017674113999998, 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.068 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:12:48.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017653737, 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:12:48.072 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.076 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.017607692999999, 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:48.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:48.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:48.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:48.081 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:48.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:48.082 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:48.082+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:48.183 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:48.182+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:48.186 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:48.186 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:48.186 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:48.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:48.284 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:48.284+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:48.336 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:48.337 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:48.337 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:48.337 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:48.337 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:48.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:48.389 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:48.388+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1026838010000004, 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.450 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.454 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1026733520000001, 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:48.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1026633989999999, 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:12:48.459 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:12:48.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.1026524750000002, 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.468 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.102642232, 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:48.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:12:48.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0966966659999997, 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.473 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:12:48.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.477 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0966755309999998, 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:12:48.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.481 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0966540370000004, 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.486 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0966310090000002, 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:48.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:12:48.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.096609634, 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.491 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965982160000003, 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.495 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.499 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965836150000001, 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:12:48.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:12:48.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965725470000001, 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.508 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965616870000003, 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.512 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965496679999998, 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.513 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965398449999997, 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.521 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965251169999997, 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:12:48.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:48.526 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965149890000001, 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:12:48.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.530 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.0965054350000001, 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:12:48.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.4427359590000002, 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:48.535 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:12:48.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:12:48.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:48.540 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:48.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:48.542 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:48.542+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:48.643 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:48.642+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:48.689 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:48.689 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:48.689 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:48.689 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:48.698 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:48.729 INFO:teuthology.orchestra.run.smithi071.stdout:truncating image image_client.0-clone31 from 0x5ee2c26 (overlap 0x11962eb) to 0xc4f871 2024-09-14T07:12:48.782 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:48.781+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:48.844 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:48.843+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:48.853 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:48.853 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:48.853 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:48.853 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:48.853 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:48.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:48.876 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-14T07:12:48.946 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:48.944+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:49.016 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:49.016 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:49.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.157717120000001, 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.017 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:12:49.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:12:49.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201246949, 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.024 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:49.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201236629, 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:12:49.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:12:49.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201217653, 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.033 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:49.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:12:49.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:12:49.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:49.037 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201206228, 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:12:49.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201194731999999, 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:12:49.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:12:49.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201183683, 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.046 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:49.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.050 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201173367999999, 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:12:49.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.201134115, 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:49.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:49.059 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.195239165, 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.063 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.195228398999999, 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.19521814, 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.068 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:12:49.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.195207434, 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.073 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:49.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:12:49.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.195193667, 2024-09-14T07:12:49.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:12:49.081 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.195183197, 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:12:49.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:12:49.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.189228038, 2024-09-14T07:12:49.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:12:49.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.189217665999999, 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.091 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:12:49.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:12:49.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.189206738999999, 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:12:49.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.189197183999999, 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:12:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:12:49.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:12:49.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.8712444919999998, 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.105 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:12:49.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:12:49.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.110 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:49.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:49.112 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:49.110+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:49.167 INFO:teuthology.orchestra.run.smithi071.stdout:4534 read 0x5ce7381 thru 0x5cea929 (0x35a9 bytes) 2024-09-14T07:12:49.177 INFO:teuthology.orchestra.run.smithi071.stdout:4535 write 0x7bb2d33 thru 0x7bbf4e3 (0xc7b1 bytes) 2024-09-14T07:12:49.180 INFO:teuthology.orchestra.run.smithi071.stdout:4536 punch from 0x244657a to 0x24547cc, (0xe252 bytes) 2024-09-14T07:12:49.180 INFO:teuthology.orchestra.run.smithi071.stdout:4537 read 0x5e553ac thru 0x5e647c7 (0xf41c bytes) 2024-09-14T07:12:49.180 INFO:teuthology.orchestra.run.smithi071.stdout:4538 read 0x7ba8d84 thru 0x7baff8e (0x720b bytes) 2024-09-14T07:12:49.189 INFO:teuthology.orchestra.run.smithi071.stdout:4540 trunc from 0x7bbf4e4 to 0xead73f0 2024-09-14T07:12:49.194 INFO:teuthology.orchestra.run.smithi071.stdout:4541 writesame 0x5aea88c thru 0x5af6dea data_size 0x1(0xc55f bytes) 2024-09-14T07:12:49.213 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:49.211+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:49.216 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:49.216 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:49.216 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:49.216 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:49.221 INFO:teuthology.orchestra.run.smithi071.stdout:4542 write 0xc0ea6c0 thru 0xc0f6e80 (0xc7c1 bytes) 2024-09-14T07:12:49.224 INFO:teuthology.orchestra.run.smithi071.stdout:4544 read 0x1cfeb51 thru 0x1d049ac (0x5e5c bytes) 2024-09-14T07:12:49.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:49.225 INFO:teuthology.orchestra.run.smithi071.stdout:4545 write 0x5bb948d thru 0x5bc83fd (0xef71 bytes) 2024-09-14T07:12:49.231 INFO:teuthology.orchestra.run.smithi071.stdout:4546 write 0xe9cef54 thru 0xe9cfcb6 (0xd63 bytes) 2024-09-14T07:12:49.234 INFO:teuthology.orchestra.run.smithi071.stdout:4549 writesame 0x8d4791 thru 0x8d8d9f data_size 0x11(0x460f bytes) 2024-09-14T07:12:49.244 INFO:teuthology.orchestra.run.smithi071.stdout:4551 read 0x8dea1ce thru 0x8df7c1d (0xda50 bytes) 2024-09-14T07:12:49.244 INFO:teuthology.orchestra.run.smithi071.stdout:4552 writesame 0xe6e3e6c thru 0xe6e5061 data_size 0xb(0x11f6 bytes) 2024-09-14T07:12:49.264 INFO:teuthology.orchestra.run.smithi071.stdout:4553 trunc from 0xead73f0 to 0x40491d 2024-09-14T07:12:49.314 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:49.312+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:49.339 INFO:teuthology.orchestra.run.smithi071.stdout:4554 trunc from 0x40491d to 0xa84524f 2024-09-14T07:12:49.344 INFO:teuthology.orchestra.run.smithi071.stdout:4555 write 0x3e0e219 thru 0x3e15a2a (0x7812 bytes) 2024-09-14T07:12:49.348 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:49.349 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:49.349 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:49.354 INFO:teuthology.orchestra.run.smithi071.stdout:4556 writesame 0xcfcc541 thru 0xcfd6477 data_size 0x1(0x9f37 bytes) 2024-09-14T07:12:49.355 INFO:teuthology.orchestra.run.smithi071.stdout:4558 read 0x981ce30 thru 0x98216f9 (0x48ca bytes) 2024-09-14T07:12:49.355 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.355 INFO:teuthology.orchestra.run.smithi071.stdout:4561 read 0x3f84632 thru 0x3f8e753 (0xa122 bytes) 2024-09-14T07:12:49.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:49.362 INFO:teuthology.orchestra.run.smithi071.stdout:4562 trunc from 0xcfd6478 to 0x7453a2a 2024-09-14T07:12:49.366 INFO:teuthology.orchestra.run.smithi071.stdout:4563 read 0x35bc273 thru 0x35be155 (0x1ee3 bytes) 2024-09-14T07:12:49.367 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.368 INFO:teuthology.orchestra.run.smithi071.stdout:4565 trunc from 0x7453a2a to 0x7612ecb 2024-09-14T07:12:49.371 INFO:teuthology.orchestra.run.smithi071.stdout:4566 write 0x5b5dc3 thru 0x5bf7ad (0x99eb bytes) 2024-09-14T07:12:49.377 INFO:teuthology.orchestra.run.smithi071.stdout:4568 trunc from 0x7612ecb to 0x31bb7ac 2024-09-14T07:12:49.392 INFO:teuthology.orchestra.run.smithi071.stdout:4570 write 0x25b24ed thru 0x25b87bb (0x62cf bytes) 2024-09-14T07:12:49.393 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.409 INFO:teuthology.orchestra.run.smithi071.stdout:4575 writesame 0xbb00e12 thru 0xbb022e7 data_size 0x15(0x14d6 bytes) 2024-09-14T07:12:49.409 INFO:teuthology.orchestra.run.smithi071.stdout:4576 write 0x17412f3 thru 0x174fd87 (0xea95 bytes) 2024-09-14T07:12:49.410 INFO:teuthology.orchestra.run.smithi071.stdout:4579 punch from 0x4f83c1e to 0x4f83fa3, (0x385 bytes) 2024-09-14T07:12:49.410 INFO:teuthology.orchestra.run.smithi071.stdout:4580 write 0x94b6a5b thru 0x94c090c (0x9eb2 bytes) 2024-09-14T07:12:49.415 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:49.413+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:49.417 INFO:teuthology.orchestra.run.smithi071.stdout:4581 trunc from 0xbb022e8 to 0xe58dec0 2024-09-14T07:12:49.422 INFO:teuthology.orchestra.run.smithi071.stdout:4583 writesame 0xe3dfeae thru 0xe3e6017 data_size 0x25(0x616a bytes) 2024-09-14T07:12:49.425 INFO:teuthology.orchestra.run.smithi071.stdout:4584 read 0x324834f thru 0x324e230 (0x5ee2 bytes) 2024-09-14T07:12:49.440 INFO:teuthology.orchestra.run.smithi071.stdout:4585 trunc from 0xe58dec0 to 0x1c99f97 2024-09-14T07:12:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:4586 writesame 0x84e2bcf thru 0x84ea70b data_size 0x1(0x7b3d bytes) 2024-09-14T07:12:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:4587 read 0x578d5eb thru 0x579b62f (0xe045 bytes) 2024-09-14T07:12:49.464 INFO:teuthology.orchestra.run.smithi071.stdout:4591 punch from 0x60e0c93 to 0x60ebaf0, (0xae5d bytes) 2024-09-14T07:12:49.469 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 71.332857912999998, 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.777541391, 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:49.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:49.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:49.483 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557268493999999, 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:12:49.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557246802999998, 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:12:49.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:12:49.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557226900000003, 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.493 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:49.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:12:49.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557205406000001, 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:12:49.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557187085000002, 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:12:49.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557160742000001, 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.508 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:49.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557140277000002, 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.513 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:12:49.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.517 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557118422000002, 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:12:49.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:12:49.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557099786999999, 2024-09-14T07:12:49.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:49.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:12:49.526 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557073645999999, 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.527 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:12:49.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.531 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557046128000003, 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.532 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:49.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557028649000003, 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:12:49.536 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:12:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.540 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.557016533000002, 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:12:49.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:49.545 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.551574514999999, 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:49.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:49.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.551555190999999, 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.550 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:49.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:12:49.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.551526340999999, 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.555 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:49.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.551485817, 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:12:49.559 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.563 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.551463792, 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:49.564 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:12:49.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:49.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:49.568 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:49.570 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:49.569+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:49.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:4592 trunc from 0x84ea70c to 0xc9cc3c7 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:4595 read 0xbd00831 thru 0xbd0ad6b (0xa53b bytes) 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.574 INFO:teuthology.orchestra.run.smithi071.stdout:4598 punch from 0x27dafb9 to 0x27e2e97, (0x7ede bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4599 read 0xf59701 thru 0xf5da46 (0x4346 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4601 writesame 0x5c9ea82 thru 0x5c9ef31 data_size 0x4(0x4b0 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4602 write 0x344b26d thru 0x344e6a7 (0x343b bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4603 read 0x7f4a00e thru 0x7f53144 (0x9137 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4604 writesame 0xd256963 thru 0xd260397 data_size 0x1(0x9a35 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4605 read 0x55dce2e thru 0x55e19ae (0x4b81 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4607 trunc from 0xd260398 to 0xaa0d9cc 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4610 write 0xa59b153 thru 0xa59fca3 (0x4b51 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4611 writesame 0x5b6bb0f thru 0x5b78a2e data_size 0x10(0xcf20 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4612 trunc from 0xaa0d9cc to 0x23bbec7 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4614 punch from 0x183c5dc to 0x18434a6, (0x6eca bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4615 punch from 0x1c4ab78 to 0x1c4f18d, (0x4615 bytes) 2024-09-14T07:12:49.575 INFO:teuthology.orchestra.run.smithi071.stdout:4618 writesame 0xdcdf5c5 thru 0xdceab87 data_size 0x1f(0xb5c3 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4619 read 0xc1382c1 thru 0xc145c37 (0xd977 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4620 punch from 0x9a85990 to 0x9a86da2, (0x1412 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4622 read 0x3c64cc8 thru 0x3c7268a (0xd9c3 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4623 read 0x84a2a61 thru 0x84aafa6 (0x8546 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4624 read 0x2f339dc thru 0x2f3fa41 (0xc066 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4625 write 0x882f7c3 thru 0x8837d39 (0x8577 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4626 read 0xb8ca2cf thru 0xb8d4471 (0xa1a3 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4627 trunc from 0xdceab88 to 0x8f7fa46 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4628 write 0xd726cd0 thru 0xd72db7d (0x6eae bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4629 write 0x17b0469 thru 0x17bef11 (0xeaa9 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4631 read 0x876c1a8 thru 0x877be1e (0xfc77 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4633 write 0x226cdcd thru 0x2275128 (0x835c bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:4634 write 0xbf278c9 thru 0xbf2b941 (0x4079 bytes) 2024-09-14T07:12:49.576 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:4637 punch from 0x5609f4f to 0x5610cc5, (0x6d76 bytes) 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:4639 read 0xc87c2bb thru 0xc889c60 (0xd9a6 bytes) 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:4640 read 0x666e39f thru 0x667b5be (0xd220 bytes) 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:4641 punch from 0xd56aea8 to 0xd577bbe, (0xcd16 bytes) 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:4642 punch from 0x6651115 to 0x6653aa8, (0x2993 bytes) 2024-09-14T07:12:49.577 INFO:teuthology.orchestra.run.smithi071.stdout:4643 read 0x90e5e3b thru 0x90e9292 (0x3458 bytes) 2024-09-14T07:12:49.580 INFO:teuthology.orchestra.run.smithi071.stdout:4644 trunc from 0xd72db7e to 0x83dccbf 2024-09-14T07:12:49.599 INFO:teuthology.orchestra.run.smithi071.stdout:4648 writesame 0xc59185d thru 0xc599ca9 data_size 0x1(0x844d bytes) 2024-09-14T07:12:49.599 INFO:teuthology.orchestra.run.smithi071.stdout:4649 read 0xbbd5a47 thru 0xbbe2089 (0xc643 bytes) 2024-09-14T07:12:49.599 INFO:teuthology.orchestra.run.smithi071.stdout:4651 write 0x51b0e3b thru 0x51b9442 (0x8608 bytes) 2024-09-14T07:12:49.601 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.601 INFO:teuthology.orchestra.run.smithi071.stdout:4655 read 0x5bdf88d thru 0x5bea7d5 (0xaf49 bytes) 2024-09-14T07:12:49.601 INFO:teuthology.orchestra.run.smithi071.stdout:4656 read 0x48be99a thru 0x48cb332 (0xc999 bytes) 2024-09-14T07:12:49.601 INFO:teuthology.orchestra.run.smithi071.stdout:4657 read 0x529b7ad thru 0x529daee (0x2342 bytes) 2024-09-14T07:12:49.608 INFO:teuthology.orchestra.run.smithi071.stdout:4658 writesame 0xdf70824 thru 0xdf71d2b data_size 0x4(0x1508 bytes) 2024-09-14T07:12:49.608 INFO:teuthology.orchestra.run.smithi071.stdout:4659 read 0x6476e08 thru 0x648510b (0xe304 bytes) 2024-09-14T07:12:49.609 INFO:teuthology.orchestra.run.smithi071.stdout:4660 write 0xe11e95 thru 0xe1c917 (0xaa83 bytes) 2024-09-14T07:12:49.609 INFO:teuthology.orchestra.run.smithi071.stdout:4663 write 0x6b618df thru 0x6b7005f (0xe781 bytes) 2024-09-14T07:12:49.612 INFO:teuthology.orchestra.run.smithi071.stdout:4664 read 0xcd83405 thru 0xcd911f4 (0xddf0 bytes) 2024-09-14T07:12:49.612 INFO:teuthology.orchestra.run.smithi071.stdout:4665 punch from 0x2e847dd to 0x2e8881e, (0x4041 bytes) 2024-09-14T07:12:49.613 INFO:teuthology.orchestra.run.smithi071.stdout:4667 punch from 0xca8245c to 0xca837f3, (0x1397 bytes) 2024-09-14T07:12:49.613 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.613 INFO:teuthology.orchestra.run.smithi071.stdout:4669 write 0x13929c7 thru 0x139b47a (0x8ab4 bytes) 2024-09-14T07:12:49.613 INFO:teuthology.orchestra.run.smithi071.stdout:4671 write 0x6a8e858 thru 0x6a9cb2d (0xe2d6 bytes) 2024-09-14T07:12:49.616 INFO:teuthology.orchestra.run.smithi071.stdout:4672 write 0x8d910a7 thru 0x8d9c289 (0xb1e3 bytes) 2024-09-14T07:12:49.618 INFO:teuthology.orchestra.run.smithi071.stdout:4675 write 0x40fc5e0 thru 0x4105233 (0x8c54 bytes) 2024-09-14T07:12:49.623 INFO:teuthology.orchestra.run.smithi071.stdout:4677 read 0xca6aad7 thru 0xca6ba70 (0xf9a bytes) 2024-09-14T07:12:49.623 INFO:teuthology.orchestra.run.smithi071.stdout:4678 read 0x4b4cf2b thru 0x4b54941 (0x7a17 bytes) 2024-09-14T07:12:49.623 INFO:teuthology.orchestra.run.smithi071.stdout:4679 writesame 0x25a608 thru 0x261676 data_size 0x1(0x706f bytes) 2024-09-14T07:12:49.638 INFO:teuthology.orchestra.run.smithi071.stdout:4680 read 0x1965313 thru 0x196647d (0x116b bytes) 2024-09-14T07:12:49.638 INFO:teuthology.orchestra.run.smithi071.stdout:4681 read 0x4e2203d thru 0x4e30992 (0xe956 bytes) 2024-09-14T07:12:49.638 INFO:teuthology.orchestra.run.smithi071.stdout:4682 punch from 0xbaa57dc to 0xbaa6f27, (0x174b bytes) 2024-09-14T07:12:49.638 INFO:teuthology.orchestra.run.smithi071.stdout:4683 writesame 0x8a871c1 thru 0x8a934bf data_size 0x1(0xc2ff bytes) 2024-09-14T07:12:49.661 INFO:teuthology.orchestra.run.smithi071.stdout:4686 punch from 0x78a1cef to 0x78abe4a, (0xa15b bytes) 2024-09-14T07:12:49.661 INFO:teuthology.orchestra.run.smithi071.stdout:4687 read 0xc769a4d thru 0xc772ae1 (0x9095 bytes) 2024-09-14T07:12:49.662 INFO:teuthology.orchestra.run.smithi071.stdout:4688 punch from 0x5de7ab5 to 0x5df685b, (0xeda6 bytes) 2024-09-14T07:12:49.662 INFO:teuthology.orchestra.run.smithi071.stdout:4689 write 0x6b1124b thru 0x6b1eb87 (0xd93d bytes) 2024-09-14T07:12:49.664 INFO:teuthology.orchestra.run.smithi071.stdout:4690 read 0xc7ff3ec thru 0xc80f20d (0xfe22 bytes) 2024-09-14T07:12:49.664 INFO:teuthology.orchestra.run.smithi071.stdout:4691 read 0xb364447 thru 0xb3651ee (0xda8 bytes) 2024-09-14T07:12:49.664 INFO:teuthology.orchestra.run.smithi071.stdout:4694 writesame 0x16a5b21 thru 0x16ac381 data_size 0x3(0x6861 bytes) 2024-09-14T07:12:49.668 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.671 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:49.669+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:49.679 INFO:teuthology.orchestra.run.smithi071.stdout:4696 trunc from 0xdf71d2c to 0x4f2337c 2024-09-14T07:12:49.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:12:49.687 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:49.687 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:49.687 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:49.687 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:49.690 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.690 INFO:teuthology.orchestra.run.smithi071.stdout:4699 read 0x1743dcf thru 0x1750488 (0xc6ba bytes) 2024-09-14T07:12:49.691 INFO:teuthology.orchestra.run.smithi071.stdout:4701 write 0x2603103 thru 0x26115f3 (0xe4f1 bytes) 2024-09-14T07:12:49.693 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.693 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.693 INFO:teuthology.orchestra.run.smithi071.stdout:4706 read 0x442b1fd thru 0x4432695 (0x7499 bytes) 2024-09-14T07:12:49.693 INFO:teuthology.orchestra.run.smithi071.stdout:4707 writesame 0x2c473c6 thru 0x2c4bc85 data_size 0x60(0x48c0 bytes) 2024-09-14T07:12:49.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:49.705 INFO:teuthology.orchestra.run.smithi071.stdout:4708 trunc from 0x4f2337c to 0xdc88ab1 2024-09-14T07:12:49.710 INFO:teuthology.orchestra.run.smithi071.stdout:4709 read 0xb7aafa2 thru 0xb7b4f88 (0x9fe7 bytes) 2024-09-14T07:12:49.710 INFO:teuthology.orchestra.run.smithi071.stdout:4710 punch from 0x84db422 to 0x84e5a2b, (0xa609 bytes) 2024-09-14T07:12:49.724 INFO:teuthology.orchestra.run.smithi071.stdout:4711 trunc from 0xdc88ab1 to 0x2915734 2024-09-14T07:12:49.758 INFO:teuthology.orchestra.run.smithi071.stdout:4713 write 0xce2a817 thru 0xce3203e (0x7828 bytes) 2024-09-14T07:12:49.762 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.762 INFO:teuthology.orchestra.run.smithi071.stdout:4717 writesame 0x1b3ba1a thru 0x1b3d9ab data_size 0x9(0x1f92 bytes) 2024-09-14T07:12:49.765 INFO:teuthology.orchestra.run.smithi071.stdout:4718 read 0xcc4f1d1 thru 0xcc5c5de (0xd40e bytes) 2024-09-14T07:12:49.765 INFO:teuthology.orchestra.run.smithi071.stdout:4719 read 0x9570569 thru 0x9573c70 (0x3708 bytes) 2024-09-14T07:12:49.765 INFO:teuthology.orchestra.run.smithi071.stdout:4720 read 0x431cae9 thru 0x4323965 (0x6e7d bytes) 2024-09-14T07:12:49.765 INFO:teuthology.orchestra.run.smithi071.stdout:4721 punch from 0x3a4e3d3 to 0x3a5c19c, (0xddc9 bytes) 2024-09-14T07:12:49.770 INFO:teuthology.orchestra.run.smithi071.stdout:4722 trunc from 0xce3203f to 0x8d52c1b 2024-09-14T07:12:49.771 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:49.770+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:49.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:49.779 INFO:teuthology.orchestra.run.smithi071.stdout:truncating to largest ever: 0xee6907f 2024-09-14T07:12:49.787 INFO:teuthology.orchestra.run.smithi071.stdout:4723 trunc from 0x8d52c1b to 0xee6907f 2024-09-14T07:12:49.793 INFO:teuthology.orchestra.run.smithi071.stdout:4724 trunc from 0xee6907f to 0xe635496 2024-09-14T07:12:49.798 INFO:teuthology.orchestra.run.smithi071.stdout:4725 write 0x2c23dd3 thru 0x2c32b25 (0xed53 bytes) 2024-09-14T07:12:49.799 INFO:teuthology.orchestra.run.smithi071.stdout:4726 writesame 0x2eb55de thru 0x2ec3a36 data_size 0x7(0xe459 bytes) 2024-09-14T07:12:49.805 INFO:teuthology.orchestra.run.smithi071.stdout:4729 read 0x8346d70 thru 0x834cf74 (0x6205 bytes) 2024-09-14T07:12:49.805 INFO:teuthology.orchestra.run.smithi071.stdout:4730 read 0x1dfd87c thru 0x1dfdf59 (0x6de bytes) 2024-09-14T07:12:49.805 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.805 INFO:teuthology.orchestra.run.smithi071.stdout:4732 writesame 0xd3a1884 thru 0xd3b0be5 data_size 0x1(0xf362 bytes) 2024-09-14T07:12:49.831 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:49.831 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:49.831 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:49.831 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:49.831 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:49.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:49.843 INFO:teuthology.orchestra.run.smithi071.stdout:4733 trunc from 0xe635496 to 0xd6e3e63 2024-09-14T07:12:49.849 INFO:teuthology.orchestra.run.smithi071.stdout:4734 read 0xadd0192 thru 0xadd3e49 (0x3cb8 bytes) 2024-09-14T07:12:49.849 INFO:teuthology.orchestra.run.smithi071.stdout:4735 write 0xcfcc10e thru 0xcfd4628 (0x851b bytes) 2024-09-14T07:12:49.851 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.851 INFO:teuthology.orchestra.run.smithi071.stdout:4737 write 0xa7bbc99 thru 0xa7c1fbc (0x6324 bytes) 2024-09-14T07:12:49.854 INFO:teuthology.orchestra.run.smithi071.stdout:4738 punch from 0xcc94377 to 0xcc95af1, (0x177a bytes) 2024-09-14T07:12:49.855 INFO:teuthology.orchestra.run.smithi071.stdout:4739 trunc from 0xd6e3e63 to 0xddfabd5 2024-09-14T07:12:49.860 INFO:teuthology.orchestra.run.smithi071.stdout:4740 writesame 0x40f81e thru 0x41300b data_size 0x1(0x37ee bytes) 2024-09-14T07:12:49.868 INFO:teuthology.orchestra.run.smithi071.stdout:4742 read 0x736d44c thru 0x7377d61 (0xa916 bytes) 2024-09-14T07:12:49.869 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.869 INFO:teuthology.orchestra.run.smithi071.stdout:4744 read 0x4e3cefa thru 0x4e44cae (0x7db5 bytes) 2024-09-14T07:12:49.872 INFO:teuthology.orchestra.run.smithi071.stdout:4745 trunc from 0xddfabd5 to 0xb4ae722 2024-09-14T07:12:49.872 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:49.870+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:49.893 INFO:teuthology.orchestra.run.smithi071.stdout:4746 trunc from 0xb4ae722 to 0x1fb4ef8 2024-09-14T07:12:49.905 INFO:teuthology.orchestra.run.smithi071.stdout:4747 read 0xcabc6a thru 0xcae177 (0x250e bytes) 2024-09-14T07:12:49.905 INFO:teuthology.orchestra.run.smithi071.stdout:4748 punch from 0x197f53e to 0x198adcf, (0xb891 bytes) 2024-09-14T07:12:49.906 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:49.911 INFO:teuthology.orchestra.run.smithi071.stdout:4752 write 0x29b39b3 thru 0x29be33d (0xa98b bytes) 2024-09-14T07:12:49.913 INFO:teuthology.orchestra.run.smithi071.stdout:4753 punch from 0x1cbe71c to 0x1cbf571, (0xe55 bytes) 2024-09-14T07:12:49.913 INFO:teuthology.orchestra.run.smithi071.stdout:4756 punch from 0x15ab50 to 0x1633a7, (0x8857 bytes) 2024-09-14T07:12:49.927 INFO:teuthology.orchestra.run.smithi071.stdout:4757 writesame 0x9a7a378 thru 0x9a7cf44 data_size 0x1(0x2bcd bytes) 2024-09-14T07:12:49.935 INFO:teuthology.orchestra.run.smithi071.stdout:4758 write 0xbe9e075 thru 0xbead751 (0xf6dd bytes) 2024-09-14T07:12:49.938 INFO:teuthology.orchestra.run.smithi071.stdout:4759 read 0x133031b thru 0x133dc74 (0xd95a bytes) 2024-09-14T07:12:49.939 INFO:teuthology.orchestra.run.smithi071.stdout:4760 read 0x8364f3a thru 0x8366dea (0x1eb1 bytes) 2024-09-14T07:12:49.939 INFO:teuthology.orchestra.run.smithi071.stdout:4761 writesame 0xc73b6e thru 0xc7dd15 data_size 0x1c(0xa1a8 bytes) 2024-09-14T07:12:49.940 INFO:teuthology.orchestra.run.smithi071.stdout:4762 write 0x198d416 thru 0x199ce10 (0xf9fb bytes) 2024-09-14T07:12:49.942 INFO:teuthology.orchestra.run.smithi071.stdout:4763 write 0x8b0a719 thru 0x8b0c788 (0x2070 bytes) 2024-09-14T07:12:49.944 INFO:teuthology.orchestra.run.smithi071.stdout:4764 punch from 0x46619a1 to 0x466b982, (0x9fe1 bytes) 2024-09-14T07:12:49.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:49.952 INFO:teuthology.orchestra.run.smithi071.stdout:4766 writesame 0xcb560dd thru 0xcb6383e data_size 0x13(0xd762 bytes) 2024-09-14T07:12:49.952 INFO:teuthology.orchestra.run.smithi071.stdout:4767 read 0xaf6efbc thru 0xaf7a819 (0xb85e bytes) 2024-09-14T07:12:49.955 INFO:teuthology.orchestra.run.smithi071.stdout:4768 trunc from 0xcb6383f to 0x9d544f7 2024-09-14T07:12:49.966 INFO:teuthology.orchestra.run.smithi071.stdout:4769 writesame 0x6ed52fb thru 0x6ee5169 data_size 0x7(0xfe6f bytes) 2024-09-14T07:12:49.966 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:49.966 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:49.972 INFO:teuthology.orchestra.run.smithi071.stdout:4770 writesame 0x79def2 thru 0x79f2b3 data_size 0x9(0x13c2 bytes) 2024-09-14T07:12:49.972 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:49.970+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:49.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:49.977 INFO:teuthology.orchestra.run.smithi071.stdout:4771 trunc from 0x9d544f7 to 0xcb68461 2024-09-14T07:12:49.982 INFO:teuthology.orchestra.run.smithi071.stdout:4772 writesame 0x99b4ad4 thru 0x99bd180 data_size 0x1(0x86ad bytes) 2024-09-14T07:12:49.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:50.001 INFO:teuthology.orchestra.run.smithi071.stdout:4774 writesame 0x58ea67a thru 0x58ed2d3 data_size 0x2(0x2c5a bytes) 2024-09-14T07:12:50.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:50.009 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:50.012 INFO:teuthology.orchestra.run.smithi071.stdout:4775 trunc from 0xcb68461 to 0x793021a 2024-09-14T07:12:50.032 INFO:teuthology.orchestra.run.smithi071.stdout:4776 write 0xc6195b4 thru 0xc626f39 (0xd986 bytes) 2024-09-14T07:12:50.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:50.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:50.035 INFO:teuthology.orchestra.run.smithi071.stdout:4777 punch from 0x8c8f9cf to 0x8c94239, (0x486a bytes) 2024-09-14T07:12:50.035 INFO:teuthology.orchestra.run.smithi071.stdout:4778 write 0x1654841 thru 0x1657c25 (0x33e5 bytes) 2024-09-14T07:12:50.048 INFO:teuthology.orchestra.run.smithi071.stdout:4779 trunc from 0xc626f3a to 0x23ff9d0 2024-09-14T07:12:50.050 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:50.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:50.050 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:50.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:50.071 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:50.073 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:50.072+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:50.077 INFO:teuthology.orchestra.run.smithi071.stdout:4780 write 0x8e04d4e thru 0x8e0b0f5 (0x63a8 bytes) 2024-09-14T07:12:50.089 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:50.089 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:50.090 INFO:teuthology.orchestra.run.smithi071.stdout:4783 write 0xd8a0b2a thru 0xd8aa29c (0x9773 bytes) 2024-09-14T07:12:50.093 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:50.093 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:50.094 INFO:teuthology.orchestra.run.smithi071.stdout:4784 read 0xa2ff046 thru 0xa305f45 (0x6f00 bytes) 2024-09-14T07:12:50.094 INFO:teuthology.orchestra.run.smithi071.stdout:4785 writesame 0x4c7c40c thru 0x4c8c363 data_size 0x4(0xff58 bytes) 2024-09-14T07:12:50.103 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.103 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.112 INFO:teuthology.orchestra.run.smithi071.stdout:4786 trunc from 0xd8aa29d to 0x4fe0e63 2024-09-14T07:12:50.116 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:50.121 INFO:teuthology.orchestra.run.smithi071.stdout:4787 write 0x178d8d4 thru 0x1794b5a (0x7287 bytes) 2024-09-14T07:12:50.123 INFO:teuthology.orchestra.run.smithi071.stdout:4788 read 0x7854fc thru 0x78898a (0x348f bytes) 2024-09-14T07:12:50.123 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.124 INFO:teuthology.orchestra.run.smithi071.stdout:4790 punch from 0x1544ea to 0x155c82, (0x1798 bytes) 2024-09-14T07:12:50.124 INFO:teuthology.orchestra.run.smithi071.stdout:4792 trunc from 0x4fe0e63 to 0x475b187 2024-09-14T07:12:50.129 INFO:teuthology.orchestra.run.smithi071.stdout:4793 writesame 0x3816379 thru 0x381a102 data_size 0x1(0x3d8a bytes) 2024-09-14T07:12:50.138 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.138 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.138 INFO:teuthology.orchestra.run.smithi071.stdout:4798 write 0x42be03a thru 0x42c202e (0x3ff5 bytes) 2024-09-14T07:12:50.141 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.141 INFO:teuthology.orchestra.run.smithi071.stdout:4801 punch from 0x304f051 to 0x304fde7, (0xd96 bytes) 2024-09-14T07:12:50.141 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.150 INFO:teuthology.orchestra.run.smithi071.stdout:4806 write 0x77c25d2 thru 0x77c4e5c (0x288b bytes) 2024-09-14T07:12:50.160 INFO:teuthology.orchestra.run.smithi071.stdout:4807 write 0x8d5f539 thru 0x8d5fc88 (0x750 bytes) 2024-09-14T07:12:50.163 INFO:teuthology.orchestra.run.smithi071.stdout:4808 punch from 0x62c515f to 0x62ce475, (0x9316 bytes) 2024-09-14T07:12:50.163 INFO:teuthology.orchestra.run.smithi071.stdout:4809 read 0x1e0c0ce thru 0x1e0f1eb (0x311e bytes) 2024-09-14T07:12:50.163 INFO:teuthology.orchestra.run.smithi071.stdout:4810 punch from 0x5d0f26b to 0x5d186ac, (0x9441 bytes) 2024-09-14T07:12:50.163 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.169 INFO:teuthology.orchestra.run.smithi071.stdout:4812 trunc from 0x8d5fc89 to 0xe5fb861 2024-09-14T07:12:50.174 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:50.173+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:50.174 INFO:teuthology.orchestra.run.smithi071.stdout:4814 write 0xa9d963c thru 0xa9dd687 (0x404c bytes) 2024-09-14T07:12:50.182 INFO:teuthology.orchestra.run.smithi071.stdout:4816 write 0xee15e8f thru 0xee20262 (0xa3d4 bytes) 2024-09-14T07:12:50.190 INFO:teuthology.orchestra.run.smithi071.stdout:4817 trunc from 0xee20263 to 0xaa64547 2024-09-14T07:12:50.199 INFO:teuthology.orchestra.run.smithi071.stdout:4818 write 0x988c8a9 thru 0x988e04b (0x17a3 bytes) 2024-09-14T07:12:50.204 INFO:teuthology.orchestra.run.smithi071.stdout:4820 trunc from 0xaa64547 to 0xd4bc141 2024-09-14T07:12:50.209 INFO:teuthology.orchestra.run.smithi071.stdout:4821 write 0xb182625 thru 0xb186ff8 (0x49d4 bytes) 2024-09-14T07:12:50.211 INFO:teuthology.orchestra.run.smithi071.stdout:4823 write 0xcdf5013 thru 0xce0196e (0xc95c bytes) 2024-09-14T07:12:50.214 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.220 INFO:teuthology.orchestra.run.smithi071.stdout:4825 writesame 0xe5604c9 thru 0xe569ca2 data_size 0x72(0x97da bytes) 2024-09-14T07:12:50.220 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.220 INFO:teuthology.orchestra.run.smithi071.stdout:4828 writesame 0x15f1376 thru 0x15f68cf data_size 0x32(0x555a bytes) 2024-09-14T07:12:50.221 INFO:teuthology.orchestra.run.smithi071.stdout:4829 write 0x4c46d15 thru 0x4c4fcae (0x8f9a bytes) 2024-09-14T07:12:50.222 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.223 INFO:teuthology.orchestra.run.smithi071.stdout:4831 read 0xe49099a thru 0xe49a911 (0x9f78 bytes) 2024-09-14T07:12:50.223 INFO:teuthology.orchestra.run.smithi071.stdout:4832 write 0x6bbd134 thru 0x6bc8400 (0xb2cd bytes) 2024-09-14T07:12:50.226 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.226 INFO:teuthology.orchestra.run.smithi071.stdout:4834 punch from 0xdf9f419 to 0xdfa3f9a, (0x4b81 bytes) 2024-09-14T07:12:50.226 INFO:teuthology.orchestra.run.smithi071.stdout:4836 write 0x1b69761 thru 0x1b6f6c7 (0x5f67 bytes) 2024-09-14T07:12:50.228 INFO:teuthology.orchestra.run.smithi071.stdout:4838 trunc from 0xe569ca3 to 0xd38c531 2024-09-14T07:12:50.234 INFO:teuthology.orchestra.run.smithi071.stdout:4839 writesame 0x55e565b thru 0x55ef3ae data_size 0x2(0x9d54 bytes) 2024-09-14T07:12:50.235 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.235 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:50.246 INFO:teuthology.orchestra.run.smithi071.stdout:4840 write 0xa1d79b thru 0xa2c3b8 (0xec1e bytes) 2024-09-14T07:12:50.253 INFO:teuthology.orchestra.run.smithi071.stdout:4841 writesame 0xd6def53 thru 0xd6e67d6 data_size 0x12(0x7884 bytes) 2024-09-14T07:12:50.253 INFO:teuthology.orchestra.run.smithi071.stdout:4842 read 0x9daf53e thru 0x9dbc280 (0xcd43 bytes) 2024-09-14T07:12:50.253 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.253 INFO:teuthology.orchestra.run.smithi071.stdout:4847 write 0xaa25224 thru 0xaa2f78a (0xa567 bytes) 2024-09-14T07:12:50.254 INFO:teuthology.orchestra.run.smithi071.stdout:4849 punch from 0x477f13d to 0x47830e9, (0x3fac bytes) 2024-09-14T07:12:50.255 INFO:teuthology.orchestra.run.smithi071.stdout:4852 read 0x5cc6ab1 thru 0x5cc7083 (0x5d3 bytes) 2024-09-14T07:12:50.255 INFO:teuthology.orchestra.run.smithi071.stdout:4853 read 0x5985c59 thru 0x598b275 (0x561d bytes) 2024-09-14T07:12:50.255 INFO:teuthology.orchestra.run.smithi071.stdout:4854 writesame 0x156adf1 thru 0x1572ca2 data_size 0x1(0x7eb2 bytes) 2024-09-14T07:12:50.271 INFO:teuthology.orchestra.run.smithi071.stdout:4856 read 0x9e0b40a thru 0x9e0fcc9 (0x48c0 bytes) 2024-09-14T07:12:50.272 INFO:teuthology.orchestra.run.smithi071.stdout:4858 punch from 0x1be96b8 to 0x1befd80, (0x66c8 bytes) 2024-09-14T07:12:50.275 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:50.274+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:50.285 INFO:teuthology.orchestra.run.smithi071.stdout:4862 trunc from 0xd6e67d7 to 0x1a4790a 2024-09-14T07:12:50.300 INFO:teuthology.orchestra.run.smithi071.stdout:4864 punch from 0x10908c2 to 0x1093363, (0x2aa1 bytes) 2024-09-14T07:12:50.300 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.301 INFO:teuthology.orchestra.run.smithi071.stdout:4868 writesame 0x106230a thru 0x106d0ca data_size 0x1(0xadc1 bytes) 2024-09-14T07:12:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:4869 writesame 0x964ce36 thru 0x965bf5d data_size 0x4(0xf128 bytes) 2024-09-14T07:12:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:4870 read 0x82494af thru 0x824d381 (0x3ed3 bytes) 2024-09-14T07:12:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:4872 write 0x4dd5709 thru 0x4dd8a8f (0x3387 bytes) 2024-09-14T07:12:50.334 INFO:teuthology.orchestra.run.smithi071.stdout:4873 clone 33 order 23 su 65536 sc 12 2024-09-14T07:12:50.359 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.359 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:50.409 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:50.407+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:50.477 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:50.476+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:50.510 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.510 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:50.577 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:50.575+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:50.621 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.621 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:50.675 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:12:50.678 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:50.676+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:50.744 INFO:teuthology.orchestra.run.smithi071.stdout:leaving image image_client.0-clone32 intact 2024-09-14T07:12:50.779 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:50.777+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:50.783 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.784 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:50.869 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-14T07:12:50.880 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:50.878+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:50.900 INFO:teuthology.orchestra.run.smithi071.stdout:4874 read 0x393b755 thru 0x393d403 (0x1caf bytes) 2024-09-14T07:12:50.901 INFO:teuthology.orchestra.run.smithi071.stdout:4875 write 0x4d7fed6 thru 0x4d8fac2 (0xfbed bytes) 2024-09-14T07:12:50.921 INFO:teuthology.orchestra.run.smithi071.stdout:4876 trunc from 0x965bf5e to 0x5570c07 2024-09-14T07:12:50.966 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:50.967 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:50.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:50.979 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:50.979 INFO:teuthology.orchestra.run.smithi071.stdout:4879 punch from 0x40afa97 to 0x40bcf52, (0xd4bb bytes) 2024-09-14T07:12:50.981 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:50.979+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:50.994 INFO:teuthology.orchestra.run.smithi071.stdout:4880 write 0xd0659bb thru 0xd0699df (0x4025 bytes) 2024-09-14T07:12:50.997 INFO:teuthology.orchestra.run.smithi071.stdout:4881 writesame 0x3e1684d thru 0x3e24f24 data_size 0x8(0xe6d8 bytes) 2024-09-14T07:12:51.009 INFO:teuthology.orchestra.run.smithi071.stdout:4882 trunc from 0xd0699e0 to 0x5d07224 2024-09-14T07:12:51.025 INFO:teuthology.orchestra.run.smithi071.stdout:4884 read 0xded2e7 thru 0xdf54de (0x81f8 bytes) 2024-09-14T07:12:51.025 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.025 INFO:teuthology.orchestra.run.smithi071.stdout:4886 read 0x25b3043 thru 0x25b94b7 (0x6475 bytes) 2024-09-14T07:12:51.041 INFO:teuthology.orchestra.run.smithi071.stdout:4887 writesame 0xd573ec5 thru 0xd574412 data_size 0x7(0x54e bytes) 2024-09-14T07:12:51.041 INFO:teuthology.orchestra.run.smithi071.stdout:4888 read 0xc9a612c thru 0xc9ada7d (0x7952 bytes) 2024-09-14T07:12:51.041 INFO:teuthology.orchestra.run.smithi071.stdout:4891 write 0x284d56e thru 0x285c3b3 (0xee46 bytes) 2024-09-14T07:12:51.042 INFO:teuthology.orchestra.run.smithi071.stdout:4892 write 0x100379a thru 0x10118c5 (0xe12c bytes) 2024-09-14T07:12:51.049 INFO:teuthology.orchestra.run.smithi071.stdout:4895 write 0xe295801 thru 0xe29c2d2 (0x6ad2 bytes) 2024-09-14T07:12:51.052 INFO:teuthology.orchestra.run.smithi071.stdout:4896 read 0x9ed0d36 thru 0x9ed5cc0 (0x4f8b bytes) 2024-09-14T07:12:51.052 INFO:teuthology.orchestra.run.smithi071.stdout:4897 read 0x4515faf thru 0x451f3c9 (0x941b bytes) 2024-09-14T07:12:51.052 INFO:teuthology.orchestra.run.smithi071.stdout:4898 write 0x9374b77 thru 0x937724f (0x26d9 bytes) 2024-09-14T07:12:51.055 INFO:teuthology.orchestra.run.smithi071.stdout:4900 writesame 0x3571c4b thru 0x3575779 data_size 0x1(0x3b2f bytes) 2024-09-14T07:12:51.064 INFO:teuthology.orchestra.run.smithi071.stdout:4901 read 0xaceb0a6 thru 0xaceeaef (0x3a4a bytes) 2024-09-14T07:12:51.064 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.064 INFO:teuthology.orchestra.run.smithi071.stdout:4906 read 0x9cd6ec9 thru 0x9cd8691 (0x17c9 bytes) 2024-09-14T07:12:51.065 INFO:teuthology.orchestra.run.smithi071.stdout:4907 write 0x58b0240 thru 0x58ba345 (0xa106 bytes) 2024-09-14T07:12:51.065 INFO:teuthology.orchestra.run.smithi071.stdout:4908 read 0x91cf689 thru 0x91d6646 (0x6fbe bytes) 2024-09-14T07:12:51.065 INFO:teuthology.orchestra.run.smithi071.stdout:4911 write 0x5bc9d56 thru 0x5bca61a (0x8c5 bytes) 2024-09-14T07:12:51.066 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.066 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.066 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.067 INFO:teuthology.orchestra.run.smithi071.stdout:4916 punch from 0x9a80b92 to 0x9a90617, (0xfa85 bytes) 2024-09-14T07:12:51.067 INFO:teuthology.orchestra.run.smithi071.stdout:4918 write 0xad66797 thru 0xad6a5d2 (0x3e3c bytes) 2024-09-14T07:12:51.070 INFO:teuthology.orchestra.run.smithi071.stdout:4919 punch from 0x507f80e to 0x5084db7, (0x55a9 bytes) 2024-09-14T07:12:51.070 INFO:teuthology.orchestra.run.smithi071.stdout:4920 writesame 0x22e8be0 thru 0x22e9614 data_size 0xd(0xa35 bytes) 2024-09-14T07:12:51.071 INFO:teuthology.orchestra.run.smithi071.stdout:4922 punch from 0x41c0666 to 0x41ce08e, (0xda28 bytes) 2024-09-14T07:12:51.071 INFO:teuthology.orchestra.run.smithi071.stdout:4924 punch from 0xb92308a to 0xb92d086, (0x9ffc bytes) 2024-09-14T07:12:51.071 INFO:teuthology.orchestra.run.smithi071.stdout:4925 write 0x382ef1a thru 0x3838b71 (0x9c58 bytes) 2024-09-14T07:12:51.079 INFO:teuthology.orchestra.run.smithi071.stdout:4926 trunc from 0xe29c2d3 to 0x8ed38d9 2024-09-14T07:12:51.081 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:51.081+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:51.090 INFO:teuthology.orchestra.run.smithi071.stdout:4927 read 0x298ab3e thru 0x2991972 (0x6e35 bytes) 2024-09-14T07:12:51.098 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.098 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.103 INFO:teuthology.orchestra.run.smithi071.stdout:4931 write 0xe1c65dd thru 0xe1d2531 (0xbf55 bytes) 2024-09-14T07:12:51.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:51.108 INFO:teuthology.orchestra.run.smithi071.stdout:4932 trunc from 0xe1d2532 to 0xd1eafb2 2024-09-14T07:12:51.115 INFO:teuthology.orchestra.run.smithi071.stdout:4936 writesame 0xee1d1 thru 0xf8f9f data_size 0xb(0xadcf bytes) 2024-09-14T07:12:51.118 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.118 INFO:teuthology.orchestra.run.smithi071.stdout:4938 write 0xb87016e thru 0xb87dc74 (0xdb07 bytes) 2024-09-14T07:12:51.122 INFO:teuthology.orchestra.run.smithi071.stdout:4940 punch from 0x12d65fb to 0x12e597f, (0xf384 bytes) 2024-09-14T07:12:51.122 INFO:teuthology.orchestra.run.smithi071.stdout:4941 writesame 0x62497fb thru 0x62523e2 data_size 0x79(0x8be8 bytes) 2024-09-14T07:12:51.127 INFO:teuthology.orchestra.run.smithi071.stdout:4942 write 0x2874a13 thru 0x2877b4f (0x313d bytes) 2024-09-14T07:12:51.129 INFO:teuthology.orchestra.run.smithi071.stdout:4943 read 0xb3b7bb1 thru 0xb3bf926 (0x7d76 bytes) 2024-09-14T07:12:51.129 INFO:teuthology.orchestra.run.smithi071.stdout:4944 write 0xadbf072 thru 0xadcc06c (0xcffb bytes) 2024-09-14T07:12:51.132 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.133 INFO:teuthology.orchestra.run.smithi071.stdout:4946 trunc from 0xd1eafb2 to 0xd71a105 2024-09-14T07:12:51.137 INFO:teuthology.orchestra.run.smithi071.stdout:4947 write 0x32e6724 thru 0x32ed732 (0x700f bytes) 2024-09-14T07:12:51.139 INFO:teuthology.orchestra.run.smithi071.stdout:4948 write 0x8baed28 thru 0x8bb301a (0x42f3 bytes) 2024-09-14T07:12:51.142 INFO:teuthology.orchestra.run.smithi071.stdout:4949 read 0xab37d51 thru 0xab3b8fd (0x3bad bytes) 2024-09-14T07:12:51.142 INFO:teuthology.orchestra.run.smithi071.stdout:4951 read 0x5d7cc6a thru 0x5d84849 (0x7be0 bytes) 2024-09-14T07:12:51.143 INFO:teuthology.orchestra.run.smithi071.stdout:4954 write 0x5f12050 thru 0x5f12aea (0xa9b bytes) 2024-09-14T07:12:51.144 INFO:teuthology.orchestra.run.smithi071.stdout:4955 punch from 0x5a58d62 to 0x5a63a5d, (0xacfb bytes) 2024-09-14T07:12:51.153 INFO:teuthology.orchestra.run.smithi071.stdout:4957 trunc from 0xd71a105 to 0x6306f42 2024-09-14T07:12:51.164 INFO:teuthology.orchestra.run.smithi071.stdout:4958 write 0x51b235b thru 0x51be8b2 (0xc558 bytes) 2024-09-14T07:12:51.166 INFO:teuthology.orchestra.run.smithi071.stdout:4960 read 0x26bc17b thru 0x26c077b (0x4601 bytes) 2024-09-14T07:12:51.166 INFO:teuthology.orchestra.run.smithi071.stdout:4961 read 0x55ec99c thru 0x55f02ed (0x3952 bytes) 2024-09-14T07:12:51.177 INFO:teuthology.orchestra.run.smithi071.stdout:4962 write 0xab8bd78 thru 0xab8ca2c (0xcb5 bytes) 2024-09-14T07:12:51.178 INFO:teuthology.orchestra.run.smithi071.stdout:4963 read 0x8c928b3 thru 0x8c9549b (0x2be9 bytes) 2024-09-14T07:12:51.178 INFO:teuthology.orchestra.run.smithi071.stdout:4964 punch from 0x8cf20e0 to 0x8cf3b1a, (0x1a3a bytes) 2024-09-14T07:12:51.182 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:51.182+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:51.190 INFO:teuthology.orchestra.run.smithi071.stdout:4966 trunc from 0xab8ca2d to 0xd392f3 2024-09-14T07:12:51.221 INFO:teuthology.orchestra.run.smithi071.stdout:4969 trunc from 0xd392f3 to 0xed0da27 2024-09-14T07:12:51.227 INFO:teuthology.orchestra.run.smithi071.stdout:4970 write 0x565e152 thru 0x56655a0 (0x744f bytes) 2024-09-14T07:12:51.230 INFO:teuthology.orchestra.run.smithi071.stdout:4971 read 0xc06dc21 thru 0xc07b898 (0xdc78 bytes) 2024-09-14T07:12:51.230 INFO:teuthology.orchestra.run.smithi071.stdout:4973 read 0x5ea3840 thru 0x5eb0c63 (0xd424 bytes) 2024-09-14T07:12:51.230 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.230 INFO:teuthology.orchestra.run.smithi071.stdout:4975 write 0xc7df6fc thru 0xc7e0f6a (0x186f bytes) 2024-09-14T07:12:51.233 INFO:teuthology.orchestra.run.smithi071.stdout:4976 write 0x937e9e5 thru 0x93833c6 (0x49e2 bytes) 2024-09-14T07:12:51.237 INFO:teuthology.orchestra.run.smithi071.stdout:4978 read 0x45ddccb thru 0x45e76ca (0x9a00 bytes) 2024-09-14T07:12:51.237 INFO:teuthology.orchestra.run.smithi071.stdout:4979 write 0xb77c321 thru 0xb78b389 (0xf069 bytes) 2024-09-14T07:12:51.238 INFO:teuthology.orchestra.run.smithi071.stdout:4981 writesame 0x6f979a0 thru 0x6f9e608 data_size 0x21(0x6c69 bytes) 2024-09-14T07:12:51.239 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.240 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.242 INFO:teuthology.orchestra.run.smithi071.stdout:4982 punch from 0x6ea8fd0 to 0x6eb5016, (0xc046 bytes) 2024-09-14T07:12:51.242 INFO:teuthology.orchestra.run.smithi071.stdout:4983 write 0xd9e37a3 thru 0xd9ef28a (0xbae8 bytes) 2024-09-14T07:12:51.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:51.257 INFO:teuthology.orchestra.run.smithi071.stdout:4988 trunc from 0xed0da27 to 0x2dbe994 2024-09-14T07:12:51.270 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.270 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.271 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.271 INFO:teuthology.orchestra.run.smithi071.stdout:4992 read 0x1ed373 thru 0x1f98cd (0xc55b bytes) 2024-09-14T07:12:51.284 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:51.282+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:51.287 INFO:teuthology.orchestra.run.smithi071.stdout:4993 write 0xacf8183 thru 0xacfc393 (0x4211 bytes) 2024-09-14T07:12:51.289 INFO:teuthology.orchestra.run.smithi071.stdout:4994 write 0x72cbe17 thru 0x72d3ddf (0x7fc9 bytes) 2024-09-14T07:12:51.300 INFO:teuthology.orchestra.run.smithi071.stdout:4995 trunc from 0xacfc394 to 0xe61f5c5 2024-09-14T07:12:51.305 INFO:teuthology.orchestra.run.smithi071.stdout:4996 read 0x94bd504 thru 0x94c49bf (0x74bc bytes) 2024-09-14T07:12:51.305 INFO:teuthology.orchestra.run.smithi071.stdout:4997 write 0x2e77d4b thru 0x2e7e4e8 (0x679e bytes) 2024-09-14T07:12:51.307 INFO:teuthology.orchestra.run.smithi071.stdout:4998 writesame 0x658c39a thru 0x6591954 data_size 0x1(0x55bb bytes) 2024-09-14T07:12:51.320 INFO:teuthology.orchestra.run.smithi071.stdout:5000 trunc from 0xe61f5c5 to 0xaae62eb 2024-09-14T07:12:51.327 INFO:teuthology.orchestra.run.smithi071.stdout:5001 writesame 0x89e5ed1 thru 0x89f17f5 data_size 0x3d(0xb925 bytes) 2024-09-14T07:12:51.332 INFO:teuthology.orchestra.run.smithi071.stdout:5002 read 0x49e9321 thru 0x49f8ce2 (0xf9c2 bytes) 2024-09-14T07:12:51.334 INFO:teuthology.orchestra.run.smithi071.stdout:5003 read 0x4fa9822 thru 0x4fb1b8f (0x836e bytes) 2024-09-14T07:12:51.334 INFO:teuthology.orchestra.run.smithi071.stdout:5004 read 0x51d6b3f thru 0x51dd760 (0x6c22 bytes) 2024-09-14T07:12:51.334 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.334 INFO:teuthology.orchestra.run.smithi071.stdout:5008 writesame 0x2ee2c23 thru 0x2ef0456 data_size 0x89(0xd834 bytes) 2024-09-14T07:12:51.341 INFO:teuthology.orchestra.run.smithi071.stdout:5009 write 0xad9d8f2 thru 0xadaab96 (0xd2a5 bytes) 2024-09-14T07:12:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:5010 read 0xa9d857b thru 0xa9debe6 (0x666c bytes) 2024-09-14T07:12:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:5013 write 0x6ee6dbe thru 0x6ef1c0f (0xae52 bytes) 2024-09-14T07:12:51.348 INFO:teuthology.orchestra.run.smithi071.stdout:5014 trunc from 0xadaab97 to 0xc7912bf 2024-09-14T07:12:51.353 INFO:teuthology.orchestra.run.smithi071.stdout:5018 write 0xabd2dd0 thru 0xabd63b5 (0x35e6 bytes) 2024-09-14T07:12:51.354 INFO:teuthology.orchestra.run.smithi071.stdout:5019 write 0x750a0d7 thru 0x751021e (0x6148 bytes) 2024-09-14T07:12:51.355 INFO:teuthology.orchestra.run.smithi071.stdout:5020 writesame 0x5bb4b0a thru 0x5bb563f data_size 0xe(0xb36 bytes) 2024-09-14T07:12:51.357 INFO:teuthology.orchestra.run.smithi071.stdout:5021 write 0x5e2de08 thru 0x5e32d78 (0x4f71 bytes) 2024-09-14T07:12:51.358 INFO:teuthology.orchestra.run.smithi071.stdout:5024 write 0x8141835 thru 0x8145707 (0x3ed3 bytes) 2024-09-14T07:12:51.359 INFO:teuthology.orchestra.run.smithi071.stdout:5025 read 0xbc0ea3 thru 0xbc893d (0x7a9b bytes) 2024-09-14T07:12:51.360 INFO:teuthology.orchestra.run.smithi071.stdout:5026 write 0xbd3c96e thru 0xbd44111 (0x77a4 bytes) 2024-09-14T07:12:51.361 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.361 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.362 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.362 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:51.371 INFO:teuthology.orchestra.run.smithi071.stdout:5032 writesame 0xd4c8b09 thru 0xd4d1672 data_size 0x2b(0x8b6a bytes) 2024-09-14T07:12:51.373 INFO:teuthology.orchestra.run.smithi071.stdout:5034 trunc from 0xd4d1673 to 0xae70a74 2024-09-14T07:12:51.379 INFO:teuthology.orchestra.run.smithi071.stdout:5036 read 0x282c9ae thru 0x28394a3 (0xcaf6 bytes) 2024-09-14T07:12:51.380 INFO:teuthology.orchestra.run.smithi071.stdout:5037 writesame 0x4e2469e thru 0x4e2b9bc data_size 0x1(0x731f bytes) 2024-09-14T07:12:51.385 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:51.383+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:51.395 INFO:teuthology.orchestra.run.smithi071.stdout:5039 read 0x7442d3a thru 0x74461b7 (0x347e bytes) 2024-09-14T07:12:51.395 INFO:teuthology.orchestra.run.smithi071.stdout:5040 read 0x5a67748 thru 0x5a75ef1 (0xe7aa bytes) 2024-09-14T07:12:51.399 INFO:teuthology.orchestra.run.smithi071.stdout:5041 trunc from 0xae70a74 to 0x7f7bc53 2024-09-14T07:12:51.408 INFO:teuthology.orchestra.run.smithi071.stdout:5043 punch from 0x6f60d7a to 0x6f6ffd4, (0xf25a bytes) 2024-09-14T07:12:51.408 INFO:teuthology.orchestra.run.smithi071.stdout:5044 punch from 0x4230980 to 0x423f3e8, (0xea68 bytes) 2024-09-14T07:12:51.419 INFO:teuthology.orchestra.run.smithi071.stdout:5045 write 0xc831da1 thru 0xc838bbd (0x6e1d bytes) 2024-09-14T07:12:51.422 INFO:teuthology.orchestra.run.smithi071.stdout:5046 punch from 0x5b9ffe to 0x5c44f1, (0xa4f3 bytes) 2024-09-14T07:12:51.422 INFO:teuthology.orchestra.run.smithi071.stdout:5047 read 0x316a205 thru 0x3172f21 (0x8d1d bytes) 2024-09-14T07:12:51.422 INFO:teuthology.orchestra.run.smithi071.stdout:5049 read 0x5b6054e thru 0x5b6c13f (0xbbf2 bytes) 2024-09-14T07:12:51.430 INFO:teuthology.orchestra.run.smithi071.stdout:5050 write 0xe81ae48 thru 0xe821555 (0x670e bytes) 2024-09-14T07:12:51.435 INFO:teuthology.orchestra.run.smithi071.stdout:5051 read 0x9bfba50 thru 0x9c07814 (0xbdc5 bytes) 2024-09-14T07:12:51.436 INFO:teuthology.orchestra.run.smithi071.stdout:5053 writesame 0x2c32f4d thru 0x2c351c4 data_size 0x4(0x2278 bytes) 2024-09-14T07:12:51.438 INFO:teuthology.orchestra.run.smithi071.stdout:5054 write 0xeaa5a3 thru 0xeb95e5 (0xf043 bytes) 2024-09-14T07:12:51.439 INFO:teuthology.orchestra.run.smithi071.stdout:5055 write 0xd562d22 thru 0xd56e742 (0xba21 bytes) 2024-09-14T07:12:51.452 INFO:teuthology.orchestra.run.smithi071.stdout:5056 trunc from 0xe821556 to 0x49f95e0 2024-09-14T07:12:51.478 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.478 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.483 INFO:teuthology.orchestra.run.smithi071.stdout:5057 writesame 0xa60eefb thru 0xa615bff data_size 0x15(0x6d05 bytes) 2024-09-14T07:12:51.484 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.486 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:51.484+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:51.488 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:51.494 INFO:teuthology.orchestra.run.smithi071.stdout:5059 write 0xe142e8f thru 0xe14e02b (0xb19d bytes) 2024-09-14T07:12:51.497 INFO:teuthology.orchestra.run.smithi071.stdout:5061 write 0x1f3979a thru 0x1f3a9ba (0x1221 bytes) 2024-09-14T07:12:51.499 INFO:teuthology.orchestra.run.smithi071.stdout:5062 punch from 0x532a6f3 to 0x5337b64, (0xd471 bytes) 2024-09-14T07:12:51.499 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.499 INFO:teuthology.orchestra.run.smithi071.stdout:5064 write 0xb2f7a3f thru 0xb301e71 (0xa433 bytes) 2024-09-14T07:12:51.503 INFO:teuthology.orchestra.run.smithi071.stdout:5065 punch from 0xbacf3b4 to 0xbad1e89, (0x2ad5 bytes) 2024-09-14T07:12:51.503 INFO:teuthology.orchestra.run.smithi071.stdout:5066 writesame 0xb8f41ef thru 0xb8fe3e4 data_size 0x1(0xa1f6 bytes) 2024-09-14T07:12:51.523 INFO:teuthology.orchestra.run.smithi071.stdout:5068 writesame 0x116228a thru 0x1163281 data_size 0xe(0xff8 bytes) 2024-09-14T07:12:51.524 INFO:teuthology.orchestra.run.smithi071.stdout:5069 punch from 0x670244b to 0x670eea7, (0xca5c bytes) 2024-09-14T07:12:51.524 INFO:teuthology.orchestra.run.smithi071.stdout:5070 punch from 0x46715e3 to 0x467a382, (0x8d9f bytes) 2024-09-14T07:12:51.530 INFO:teuthology.orchestra.run.smithi071.stdout:5072 trunc from 0xe14e02c to 0x9054979 2024-09-14T07:12:51.542 INFO:teuthology.orchestra.run.smithi071.stdout:5073 read 0x85dd145 thru 0x85eb2ae (0xe16a bytes) 2024-09-14T07:12:51.542 INFO:teuthology.orchestra.run.smithi071.stdout:5075 write 0x89278ec thru 0x892d53c (0x5c51 bytes) 2024-09-14T07:12:51.556 INFO:teuthology.orchestra.run.smithi071.stdout:5076 write 0xda2254e thru 0xda289c9 (0x647c bytes) 2024-09-14T07:12:51.559 INFO:teuthology.orchestra.run.smithi071.stdout:5078 punch from 0x7c9723c to 0x7ca0cf9, (0x9abd bytes) 2024-09-14T07:12:51.560 INFO:teuthology.orchestra.run.smithi071.stdout:5079 trunc from 0xda289ca to 0xed53656 2024-09-14T07:12:51.565 INFO:teuthology.orchestra.run.smithi071.stdout:5084 writesame 0xde95665 thru 0xde96e03 data_size 0x1(0x179f bytes) 2024-09-14T07:12:51.570 INFO:teuthology.orchestra.run.smithi071.stdout:5085 punch from 0x6d976ca to 0x6da1039, (0x996f bytes) 2024-09-14T07:12:51.570 INFO:teuthology.orchestra.run.smithi071.stdout:5087 punch from 0xa92a6b6 to 0xa935223, (0xab6d bytes) 2024-09-14T07:12:51.570 INFO:teuthology.orchestra.run.smithi071.stdout:5088 flatten 2024-09-14T07:12:51.576 INFO:teuthology.orchestra.run.smithi071.stdout:5089 write 0x452e936 thru 0x453476c (0x5e37 bytes) 2024-09-14T07:12:51.577 INFO:teuthology.orchestra.run.smithi071.stdout:5090 write 0xc9fbf60 thru 0xca09c73 (0xdd14 bytes) 2024-09-14T07:12:51.581 INFO:teuthology.orchestra.run.smithi071.stdout:5091 writesame 0x5715752 thru 0x5722d7c data_size 0x1(0xd62b bytes) 2024-09-14T07:12:51.586 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:51.585+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:51.594 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.594 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:51.607 INFO:teuthology.orchestra.run.smithi071.stdout:5093 writesame 0xad78645 thru 0xad878a8 data_size 0x6(0xf264 bytes) 2024-09-14T07:12:51.621 INFO:teuthology.orchestra.run.smithi071.stdout:5094 trunc from 0xed53656 to 0x962f337 2024-09-14T07:12:51.641 INFO:teuthology.orchestra.run.smithi071.stdout:5095 trunc from 0x962f337 to 0x2c5f4e5 2024-09-14T07:12:51.670 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:51.671 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:12:51.671 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T07:12:51.671 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T07:12:51.671 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T07:12:51.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T07:12:51.674 INFO:teuthology.orchestra.run.smithi071.stdout:5096 write 0xd2d7274 thru 0xd2d8d07 (0x1a94 bytes) 2024-09-14T07:12:51.677 INFO:teuthology.orchestra.run.smithi071.stdout:5098 read 0x78e0ea3 thru 0x78efbbf (0xed1d bytes) 2024-09-14T07:12:51.684 INFO:teuthology.orchestra.run.smithi071.stdout:5099 write 0xe3f2dc5 thru 0xe3f5868 (0x2aa4 bytes) 2024-09-14T07:12:51.689 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:51.688+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:51.692 INFO:teuthology.orchestra.run.smithi071.stdout:5100 write 0xed29fbe thru 0xed33a37 (0x9a7a bytes) 2024-09-14T07:12:51.700 INFO:teuthology.orchestra.run.smithi071.stdout:5101 punch from 0xd8807f6 to 0xd888284, (0x7a8e bytes) 2024-09-14T07:12:51.700 INFO:teuthology.orchestra.run.smithi071.stdout:5102 write 0xa8580af thru 0xa863333 (0xb285 bytes) 2024-09-14T07:12:51.703 INFO:teuthology.orchestra.run.smithi071.stdout:5103 read 0x666c2b6 thru 0x667bb66 (0xf8b1 bytes) 2024-09-14T07:12:51.704 INFO:teuthology.orchestra.run.smithi071.stdout:5104 write 0xc6cf587 thru 0xc6d96a2 (0xa11c bytes) 2024-09-14T07:12:51.707 INFO:teuthology.orchestra.run.smithi071.stdout:5105 read 0x486976a thru 0x487967a (0xff11 bytes) 2024-09-14T07:12:51.707 INFO:teuthology.orchestra.run.smithi071.stdout:5106 writesame 0xc41cb5a thru 0xc427725 data_size 0x1e(0xabcc bytes) 2024-09-14T07:12:51.728 INFO:teuthology.orchestra.run.smithi071.stdout:5107 trunc from 0xed33a38 to 0x283e2ef 2024-09-14T07:12:51.743 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.744 INFO:teuthology.orchestra.run.smithi071.stdout:5109 read 0xfff141 thru 0x100ba36 (0xc8f6 bytes) 2024-09-14T07:12:51.749 INFO:teuthology.orchestra.run.smithi071.stdout:5110 write 0x2aa35d7 thru 0x2aab2ca (0x7cf4 bytes) 2024-09-14T07:12:51.752 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.752 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:51.769 INFO:teuthology.orchestra.run.smithi071.stdout:5111 writesame 0xe1ca9be thru 0xe1d5055 data_size 0x8(0xa698 bytes) 2024-09-14T07:12:51.784 INFO:teuthology.orchestra.run.smithi071.stdout:5115 trunc from 0xe1d5056 to 0x1a9686d 2024-09-14T07:12:51.791 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T07:12:51.791 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:51.804 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:51.802+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:51.813 INFO:teuthology.orchestra.run.smithi071.stdout:5116 write 0xe4782af thru 0xe47dd8c (0x5ade bytes) 2024-09-14T07:12:51.816 INFO:teuthology.orchestra.run.smithi071.stdout:5119 read 0x485e2fd thru 0x4866006 (0x7d0a bytes) 2024-09-14T07:12:51.816 INFO:teuthology.orchestra.run.smithi071.stdout:5120 punch from 0x954c310 to 0x9552eaf, (0x6b9f bytes) 2024-09-14T07:12:51.816 INFO:teuthology.orchestra.run.smithi071.stdout:5121 read 0x75eb052 thru 0x75f3860 (0x880f bytes) 2024-09-14T07:12:51.816 INFO:teuthology.orchestra.run.smithi071.stdout:5122 writesame 0x2dbe89f thru 0x2dc6ca6 data_size 0x41(0x8408 bytes) 2024-09-14T07:12:51.817 INFO:teuthology.orchestra.run.smithi071.stdout:5124 trunc from 0xe47dd8d to 0xe332805 2024-09-14T07:12:51.823 INFO:teuthology.orchestra.run.smithi071.stdout:5125 write 0x610fe19 thru 0x611868d (0x8875 bytes) 2024-09-14T07:12:51.828 INFO:teuthology.orchestra.run.smithi071.stdout:5126 read 0xa86c386 thru 0xa876b0c (0xa787 bytes) 2024-09-14T07:12:51.829 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.829 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.829 INFO:teuthology.orchestra.run.smithi071.stdout:5130 write 0xd00f5cf thru 0xd01cef0 (0xd922 bytes) 2024-09-14T07:12:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:5132 punch from 0x2c5ec27 to 0x2c6b752, (0xcb2b bytes) 2024-09-14T07:12:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:5135 read 0x891600a thru 0x891f7d2 (0x97c9 bytes) 2024-09-14T07:12:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:5136 punch from 0x850b74c to 0x8515835, (0xa0e9 bytes) 2024-09-14T07:12:51.834 INFO:teuthology.orchestra.run.smithi071.stdout:5137 write 0x939474e thru 0x939529b (0xb4e bytes) 2024-09-14T07:12:51.851 INFO:teuthology.orchestra.run.smithi071.stdout:5138 trunc from 0xe332805 to 0x1a92192 2024-09-14T07:12:51.867 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.874 INFO:teuthology.orchestra.run.smithi071.stdout:5141 write 0x39522a9 thru 0x3956295 (0x3fed bytes) 2024-09-14T07:12:51.888 INFO:teuthology.orchestra.run.smithi071.stdout:5143 writesame 0x98711b3 thru 0x9873b1f data_size 0x23(0x296d bytes) 2024-09-14T07:12:51.888 INFO:teuthology.orchestra.run.smithi071.stdout:5144 writesame 0xbb5562 thru 0xbba40a data_size 0x1(0x4ea9 bytes) 2024-09-14T07:12:51.889 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:51.887+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:51.899 INFO:teuthology.orchestra.run.smithi071.stdout:5145 writesame 0x4c04792 thru 0x4c08409 data_size 0x18(0x3c78 bytes) 2024-09-14T07:12:51.901 INFO:teuthology.orchestra.run.smithi071.stdout:5147 write 0x168fbcf thru 0x169a353 (0xa785 bytes) 2024-09-14T07:12:51.904 INFO:teuthology.orchestra.run.smithi071.stdout:5148 trunc from 0x9873b20 to 0x884d897 2024-09-14T07:12:51.909 INFO:teuthology.orchestra.run.smithi071.stdout:5149 read 0x13110f5 thru 0x131801d (0x6f29 bytes) 2024-09-14T07:12:51.911 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:51.911 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:51.915 INFO:teuthology.orchestra.run.smithi071.stdout:5151 trunc from 0x884d897 to 0x467e039 2024-09-14T07:12:51.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:51.924 INFO:teuthology.orchestra.run.smithi071.stdout:5152 write 0x146126d thru 0x146b8ec (0xa680 bytes) 2024-09-14T07:12:51.925 INFO:teuthology.orchestra.run.smithi071.stdout:5153 read 0x70e8d4 thru 0x710c7e (0x23ab bytes) 2024-09-14T07:12:51.928 INFO:teuthology.orchestra.run.smithi071.stdout:5155 read 0x2d0031d thru 0x2d09530 (0x9214 bytes) 2024-09-14T07:12:51.929 INFO:teuthology.orchestra.run.smithi071.stdout:5156 read 0x33ec1c3 thru 0x33fbd6a (0xfba8 bytes) 2024-09-14T07:12:51.937 INFO:teuthology.orchestra.run.smithi071.stdout:5158 trunc from 0x467e039 to 0xd2df4a1 2024-09-14T07:12:51.943 INFO:teuthology.orchestra.run.smithi071.stdout:5159 read 0x914f9b3 thru 0x915d469 (0xdab7 bytes) 2024-09-14T07:12:51.943 INFO:teuthology.orchestra.run.smithi071.stdout:5160 trunc from 0xd2df4a1 to 0xd23d5e1 2024-09-14T07:12:51.947 INFO:teuthology.orchestra.run.smithi071.stdout:5161 read 0x5851b39 thru 0x5857232 (0x56fa bytes) 2024-09-14T07:12:51.948 INFO:teuthology.orchestra.run.smithi071.stdout:5162 write 0xb281a85 thru 0xb28b763 (0x9cdf bytes) 2024-09-14T07:12:51.950 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.950 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.951 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.951 INFO:teuthology.orchestra.run.smithi071.stdout:5169 read 0xbc2753e thru 0xbc2a70f (0x31d2 bytes) 2024-09-14T07:12:51.964 INFO:teuthology.orchestra.run.smithi071.stdout:5170 trunc from 0xd23d5e1 to 0x1960423 2024-09-14T07:12:51.978 INFO:teuthology.orchestra.run.smithi071.stdout:5171 punch from 0xccb08a to 0xcd88d9, (0xd84f bytes) 2024-09-14T07:12:51.989 INFO:teuthology.orchestra.run.smithi071.stdout:5173 writesame 0x3d94788 thru 0x3d9a699 data_size 0x2b(0x5f12 bytes) 2024-09-14T07:12:51.990 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:51.988+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:51.990 INFO:teuthology.orchestra.run.smithi071.stdout:5174 punch from 0x35baf76 to 0x35c6cb0, (0xbd3a bytes) 2024-09-14T07:12:51.990 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:51.990 INFO:teuthology.orchestra.run.smithi071.stdout:5176 punch from 0x162090d to 0x1625244, (0x4937 bytes) 2024-09-14T07:12:52.009 INFO:teuthology.orchestra.run.smithi071.stdout:5177 write 0xe56c4d8 thru 0xe579ccb (0xd7f4 bytes) 2024-09-14T07:12:52.021 INFO:teuthology.orchestra.run.smithi071.stdout:5178 write 0xe942b29 thru 0xe94ed72 (0xc24a bytes) 2024-09-14T07:12:52.024 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.024 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.025 INFO:teuthology.orchestra.run.smithi071.stdout:5182 writesame 0x3714eb7 thru 0x372056e data_size 0xc(0xb6b8 bytes) 2024-09-14T07:12:52.026 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:52.026 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:52.027 INFO:teuthology.orchestra.run.smithi071.stdout:5183 write 0xa44ffa7 thru 0xa452c7d (0x2cd7 bytes) 2024-09-14T07:12:52.034 INFO:teuthology.orchestra.run.smithi071.stdout:5184 write 0x5ea3c04 thru 0x5eb2446 (0xe843 bytes) 2024-09-14T07:12:52.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:5186 read 0x62dd1f6 thru 0x62e32cc (0x60d7 bytes) 2024-09-14T07:12:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:5189 read 0x2bd532b thru 0x2bd7c78 (0x294e bytes) 2024-09-14T07:12:52.036 INFO:teuthology.orchestra.run.smithi071.stdout:5190 write 0x7d83d0 thru 0x7e1737 (0x9368 bytes) 2024-09-14T07:12:52.037 INFO:teuthology.orchestra.run.smithi071.stdout:5192 writesame 0xe23ab89 thru 0xe24a4d6 data_size 0x21(0xf94e bytes) 2024-09-14T07:12:52.041 INFO:teuthology.orchestra.run.smithi071.stdout:5193 write 0x993c8a0 thru 0x9946b08 (0xa269 bytes) 2024-09-14T07:12:52.046 INFO:teuthology.orchestra.run.smithi071.stdout:5194 trunc from 0xe94ed73 to 0xdf966c7 2024-09-14T07:12:52.053 INFO:teuthology.orchestra.run.smithi071.stdout:5197 read 0x478fbab thru 0x479ea38 (0xee8e bytes) 2024-09-14T07:12:52.054 INFO:teuthology.orchestra.run.smithi071.stdout:5198 writesame 0x99d20b thru 0x9a2112 data_size 0xc(0x4f08 bytes) 2024-09-14T07:12:52.056 INFO:teuthology.orchestra.run.smithi071.stdout:5200 trunc from 0xdf966c7 to 0xe97b4ce 2024-09-14T07:12:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:5201 read 0x9a3a361 thru 0x9a436ab (0x934b bytes) 2024-09-14T07:12:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:5202 punch from 0x9f18a5e to 0x9f223db, (0x997d bytes) 2024-09-14T07:12:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:5203 write 0x894e4f0 thru 0x8957aa2 (0x95b3 bytes) 2024-09-14T07:12:52.064 INFO:teuthology.orchestra.run.smithi071.stdout:5204 read 0x928aa5a thru 0x9291da8 (0x734f bytes) 2024-09-14T07:12:52.065 INFO:teuthology.orchestra.run.smithi071.stdout:5205 read 0x7c4664f thru 0x7c474de (0xe90 bytes) 2024-09-14T07:12:52.065 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.065 INFO:teuthology.orchestra.run.smithi071.stdout:5207 punch from 0x1ae54b1 to 0x1ae5a85, (0x5d4 bytes) 2024-09-14T07:12:52.067 INFO:teuthology.orchestra.run.smithi071.stdout:5210 trunc from 0xe97b4ce to 0xca49585 2024-09-14T07:12:52.081 INFO:teuthology.orchestra.run.smithi071.stdout:5211 writesame 0xd33e5d3 thru 0xd346260 data_size 0x2(0x7c8e bytes) 2024-09-14T07:12:52.082 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.082 INFO:teuthology.orchestra.run.smithi071.stdout:5213 read 0x54d74f2 thru 0x54e27d3 (0xb2e2 bytes) 2024-09-14T07:12:52.090 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:52.089+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:52.091 INFO:teuthology.orchestra.run.smithi071.stdout:5214 trunc from 0xd346261 to 0x5ef0c61 2024-09-14T07:12:52.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:52.115 INFO:teuthology.orchestra.run.smithi071.stdout:5215 writesame 0x78f4cf1 thru 0x78fb43b data_size 0x1(0x674b bytes) 2024-09-14T07:12:52.116 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.116 INFO:teuthology.orchestra.run.smithi071.stdout:5217 read 0x7a7b17 thru 0x7ac26f (0x4759 bytes) 2024-09-14T07:12:52.117 INFO:teuthology.orchestra.run.smithi071.stdout:5219 punch from 0x1e1a5a7 to 0x1e1f196, (0x4bef bytes) 2024-09-14T07:12:52.117 INFO:teuthology.orchestra.run.smithi071.stdout:5221 read 0xdd56f0 thru 0xddb729 (0x603a bytes) 2024-09-14T07:12:52.117 INFO:teuthology.orchestra.run.smithi071.stdout:5222 write 0x4c6758d thru 0x4c74f3d (0xd9b1 bytes) 2024-09-14T07:12:52.118 INFO:teuthology.orchestra.run.smithi071.stdout:5224 write 0x3b9ed48 thru 0x3baea50 (0xfd09 bytes) 2024-09-14T07:12:52.131 INFO:teuthology.orchestra.run.smithi071.stdout:5225 write 0xb3edd9c thru 0xb3fa7c7 (0xca2c bytes) 2024-09-14T07:12:52.136 INFO:teuthology.orchestra.run.smithi071.stdout:5226 write 0x57878ee thru 0x579439c (0xcaaf bytes) 2024-09-14T07:12:52.137 INFO:teuthology.orchestra.run.smithi071.stdout:5227 write 0x211235d thru 0x211704a (0x4cee bytes) 2024-09-14T07:12:52.146 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:52.146 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:52.149 INFO:teuthology.orchestra.run.smithi071.stdout:5228 trunc from 0xb3fa7c8 to 0x1d8966f 2024-09-14T07:12:52.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:52.162 INFO:teuthology.orchestra.run.smithi071.stdout:5231 punch from 0x6e4023 to 0x6edea5, (0x9e82 bytes) 2024-09-14T07:12:52.162 INFO:teuthology.orchestra.run.smithi071.stdout:5232 punch from 0x1205dea to 0x1207e52, (0x2068 bytes) 2024-09-14T07:12:52.162 INFO:teuthology.orchestra.run.smithi071.stdout:5233 trunc from 0x1d8966f to 0x1ac2dfc 2024-09-14T07:12:52.184 INFO:teuthology.orchestra.run.smithi071.stdout:5235 writesame 0x848cb21 thru 0x8495f5e data_size 0x8a(0x943e bytes) 2024-09-14T07:12:52.185 INFO:teuthology.orchestra.run.smithi071.stdout:5236 read 0x29ef7af thru 0x29fc8b3 (0xd105 bytes) 2024-09-14T07:12:52.185 INFO:teuthology.orchestra.run.smithi071.stdout:5238 punch from 0x23612f4 to 0x236ee0f, (0xdb1b bytes) 2024-09-14T07:12:52.186 INFO:teuthology.orchestra.run.smithi071.stdout:5239 punch from 0x31af736 to 0x31b444a, (0x4d14 bytes) 2024-09-14T07:12:52.186 INFO:teuthology.orchestra.run.smithi071.stdout:5240 write 0x374f9f7 thru 0x3750859 (0xe63 bytes) 2024-09-14T07:12:52.195 INFO:teuthology.orchestra.run.smithi071.stdout:5241 writesame 0xb76a17e thru 0xb772c19 data_size 0xc(0x8a9c bytes) 2024-09-14T07:12:52.195 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.195 INFO:teuthology.orchestra.run.smithi071.stdout:5244 trunc from 0xb772c1a to 0xb6c92d3 2024-09-14T07:12:52.198 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:52.198+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:52.199 INFO:teuthology.orchestra.run.smithi071.stdout:5245 write 0x17484da thru 0x174c273 (0x3d9a bytes) 2024-09-14T07:12:52.201 INFO:teuthology.orchestra.run.smithi071.stdout:5247 punch from 0x40cc57d to 0x40d37f7, (0x727a bytes) 2024-09-14T07:12:52.201 INFO:teuthology.orchestra.run.smithi071.stdout:5248 read 0xa1cdea1 thru 0xa1dd8fe (0xfa5e bytes) 2024-09-14T07:12:52.214 INFO:teuthology.orchestra.run.smithi071.stdout:5249 trunc from 0xb6c92d3 to 0xf6069f 2024-09-14T07:12:52.223 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:52.235 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:52.235 INFO:teuthology.orchestra.run.smithi071.stdout:5253 writesame 0x6625eea thru 0x66336dc data_size 0x1(0xd7f3 bytes) 2024-09-14T07:12:52.246 INFO:teuthology.orchestra.run.smithi071.stdout:5254 write 0xb676647 thru 0xb67bb68 (0x5522 bytes) 2024-09-14T07:12:52.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:52.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:52.259 INFO:teuthology.orchestra.run.smithi071.stdout:5258 trunc from 0xb67bb69 to 0x307aa83 2024-09-14T07:12:52.262 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:52.262 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:52.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:52.279 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:52.279 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:52.284 INFO:teuthology.orchestra.run.smithi071.stdout:5259 trunc from 0x307aa83 to 0xa215a9f 2024-09-14T07:12:52.289 INFO:teuthology.orchestra.run.smithi071.stdout:5260 write 0x73f6b93 thru 0x73fed3d (0x81ab bytes) 2024-09-14T07:12:52.291 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:52.289+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:52.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:52.299 INFO:teuthology.orchestra.run.smithi071.stdout:5264 write 0xb513867 thru 0xb51e4f5 (0xac8f bytes) 2024-09-14T07:12:52.302 INFO:teuthology.orchestra.run.smithi071.stdout:5265 trunc from 0xb51e4f6 to 0xae94f34 2024-09-14T07:12:52.308 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.311 INFO:teuthology.orchestra.run.smithi071.stdout:5267 trunc from 0xae94f34 to 0xcebc4b7 2024-09-14T07:12:52.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:52.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:52.319 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:52.319 INFO:teuthology.orchestra.run.smithi071.stdout:5268 trunc from 0xcebc4b7 to 0xc72e0be 2024-09-14T07:12:52.325 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.325 INFO:teuthology.orchestra.run.smithi071.stdout:5270 write 0x9a37893 thru 0x9a437ed (0xbf5b bytes) 2024-09-14T07:12:52.328 INFO:teuthology.orchestra.run.smithi071.stdout:5271 read 0x4159b77 thru 0x4163189 (0x9613 bytes) 2024-09-14T07:12:52.335 INFO:teuthology.orchestra.run.smithi071.stdout:5275 write 0xd672fc3 thru 0xd6794e4 (0x6522 bytes) 2024-09-14T07:12:52.337 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:52.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:52.338 INFO:teuthology.orchestra.run.smithi071.stdout:5276 read 0xc06f19a thru 0xc07344e (0x42b5 bytes) 2024-09-14T07:12:52.338 INFO:teuthology.orchestra.run.smithi071.stdout:5278 read 0x7b91f36 thru 0x7ba0353 (0xe41e bytes) 2024-09-14T07:12:52.348 INFO:teuthology.orchestra.run.smithi071.stdout:5279 trunc from 0xd6794e5 to 0x56ba4d1 2024-09-14T07:12:52.357 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:52.358 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:52.361 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:52.361 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:52.364 INFO:teuthology.orchestra.run.smithi071.stdout:5280 writesame 0x4130786 thru 0x4133d46 data_size 0x3(0x35c1 bytes) 2024-09-14T07:12:52.377 INFO:teuthology.orchestra.run.smithi071.stdout:5282 writesame 0x9480299 thru 0x948a384 data_size 0x6(0xa0ec bytes) 2024-09-14T07:12:52.381 INFO:teuthology.orchestra.run.smithi071.stdout:5286 trunc from 0x948a385 to 0x6658005 2024-09-14T07:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:5288 trunc from 0x6658005 to 0xb1596a3 2024-09-14T07:12:52.392 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:52.391+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:52.397 INFO:teuthology.orchestra.run.smithi071.stdout:5289 punch from 0x870091f to 0x870bf03, (0xb5e4 bytes) 2024-09-14T07:12:52.397 INFO:teuthology.orchestra.run.smithi071.stdout:5290 read 0xa70e99d thru 0xa710cca (0x232e bytes) 2024-09-14T07:12:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:5291 trunc from 0xb1596a3 to 0x8c88b46 2024-09-14T07:12:52.405 INFO:teuthology.orchestra.run.smithi071.stdout:5292 punch from 0x1bc80a8 to 0x1bd01c0, (0x8118 bytes) 2024-09-14T07:12:52.408 INFO:teuthology.orchestra.run.smithi071.stdout:5293 trunc from 0x8c88b46 to 0x5fc4b36 2024-09-14T07:12:52.417 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.417 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.417 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.417 INFO:teuthology.orchestra.run.smithi071.stdout:5298 read 0x5517f01 thru 0x5520b05 (0x8c05 bytes) 2024-09-14T07:12:52.423 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.286976566999996, 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:52.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:52.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:52.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 49.731660044999998, 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:52.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:52.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:52.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:52.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:52.440 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511387147999997, 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:12:52.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511365456999997, 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:52.451 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511345554000002, 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:12:52.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:12:52.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.51132406, 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:12:52.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511305739000001, 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.461 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.465 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511279395999999, 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.469 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511258931, 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511237076, 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:12:52.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511218440999997, 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511192299999998, 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.484 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:12:52.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:12:52.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511164782000002, 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:12:52.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511147303000001, 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.494 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:12:52.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:12:52.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.511135187000001, 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.499 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:52.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:12:52.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:12:52.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.505693168999997, 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:12:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:12:52.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.505673844999997, 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.508 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:12:52.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.512 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.505644994999997, 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.513 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:52.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:12:52.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:12:52.516 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.505604470999998, 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.517 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.505582445999998, 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:12:52.522 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.526 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.527 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:52.527 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:52.527 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:52.529 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:52.527+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:52.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:52.530 INFO:teuthology.orchestra.run.smithi071.stdout:5299 write 0x7dfe25c thru 0x7e0a274 (0xc019 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5301 punch from 0xe68207 to 0xe7448e, (0xc287 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5303 read 0x1447289 thru 0x144f91b (0x8693 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5304 read 0x59e9475 thru 0x59f2c53 (0x97df bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5305 read 0x67dfa62 thru 0x67e5855 (0x5df4 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5307 write 0xe791316 thru 0xe7996b0 (0x839b bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5308 punch from 0xb7b5401 to 0xb7b89a9, (0x35a8 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5310 trunc from 0xe7996b1 to 0xe2c418 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5312 write 0xc8fc80c thru 0xc908ffd (0xc7f2 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5313 punch from 0x17da6cb to 0x17e0ecb, (0x6800 bytes) 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5314 trunc from 0xc908ffe to 0x9d9bb0d 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5315 trunc from 0x9d9bb0d to 0xb5288f0 2024-09-14T07:12:52.531 INFO:teuthology.orchestra.run.smithi071.stdout:5316 writesame 0xea40d75 thru 0xea48396 data_size 0x1(0x7622 bytes) 2024-09-14T07:12:52.532 INFO:teuthology.orchestra.run.smithi071.stdout:5317 read 0xd980947 thru 0xd982961 (0x201b bytes) 2024-09-14T07:12:52.545 INFO:teuthology.orchestra.run.smithi071.stdout:5318 trunc from 0xea48397 to 0x2a6bf12 2024-09-14T07:12:52.557 INFO:teuthology.orchestra.run.smithi071.stdout:5320 read 0x254ec50 thru 0x2551678 (0x2a29 bytes) 2024-09-14T07:12:52.557 INFO:teuthology.orchestra.run.smithi071.stdout:5321 read 0xedc871 thru 0xee9c5c (0xd3ec bytes) 2024-09-14T07:12:52.557 INFO:teuthology.orchestra.run.smithi071.stdout:5322 write 0xf9cbc2 thru 0xfa8511 (0xb950 bytes) 2024-09-14T07:12:52.578 INFO:teuthology.orchestra.run.smithi071.stdout:5324 write 0xe816787 thru 0xe817bfe (0x1478 bytes) 2024-09-14T07:12:52.584 INFO:teuthology.orchestra.run.smithi071.stdout:5325 trunc from 0xe817bff to 0xca14533 2024-09-14T07:12:52.590 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.591 INFO:teuthology.orchestra.run.smithi071.stdout:5328 write 0x2a698b7 thru 0x2a76297 (0xc9e1 bytes) 2024-09-14T07:12:52.592 INFO:teuthology.orchestra.run.smithi071.stdout:5330 punch from 0x8ecc6d9 to 0x8ed61b6, (0x9add bytes) 2024-09-14T07:12:52.592 INFO:teuthology.orchestra.run.smithi071.stdout:5331 read 0x759cddd thru 0x75a9d47 (0xcf6b bytes) 2024-09-14T07:12:52.598 INFO:teuthology.orchestra.run.smithi071.stdout:5332 write 0xdb201d5 thru 0xdb22329 (0x2155 bytes) 2024-09-14T07:12:52.601 INFO:teuthology.orchestra.run.smithi071.stdout:5333 read 0xbad862e thru 0xbadf70d (0x70e0 bytes) 2024-09-14T07:12:52.601 INFO:teuthology.orchestra.run.smithi071.stdout:5334 read 0xa98a555 thru 0xa98a63a (0xe6 bytes) 2024-09-14T07:12:52.602 INFO:teuthology.orchestra.run.smithi071.stdout:5335 trunc from 0xdb2232a to 0xe644e84 2024-09-14T07:12:52.608 INFO:teuthology.orchestra.run.smithi071.stdout:5337 read 0x7af6259 thru 0x7afc948 (0x66f0 bytes) 2024-09-14T07:12:52.608 INFO:teuthology.orchestra.run.smithi071.stdout:5338 punch from 0x2197956 to 0x219a13d, (0x27e7 bytes) 2024-09-14T07:12:52.608 INFO:teuthology.orchestra.run.smithi071.stdout:5339 punch from 0xd7248c7 to 0xd72ebd6, (0xa30f bytes) 2024-09-14T07:12:52.608 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.608 INFO:teuthology.orchestra.run.smithi071.stdout:5342 write 0x1ffd807 thru 0x2009ed2 (0xc6cc bytes) 2024-09-14T07:12:52.609 INFO:teuthology.orchestra.run.smithi071.stdout:5343 trunc from 0xe644e84 to 0xe1374e8 2024-09-14T07:12:52.616 INFO:teuthology.orchestra.run.smithi071.stdout:5344 punch from 0x397ff6b to 0x3983f22, (0x3fb7 bytes) 2024-09-14T07:12:52.617 INFO:teuthology.orchestra.run.smithi071.stdout:5345 read 0x53f99a7 thru 0x5404cb0 (0xb30a bytes) 2024-09-14T07:12:52.617 INFO:teuthology.orchestra.run.smithi071.stdout:5346 read 0x69a520a thru 0x69a6d15 (0x1b0c bytes) 2024-09-14T07:12:52.622 INFO:teuthology.orchestra.run.smithi071.stdout:5347 trunc from 0xe1374e8 to 0x96f9c08 2024-09-14T07:12:52.628 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:52.627+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:52.634 INFO:teuthology.orchestra.run.smithi071.stdout:5348 punch from 0x5a515b1 to 0x5a55bb2, (0x4601 bytes) 2024-09-14T07:12:52.634 INFO:teuthology.orchestra.run.smithi071.stdout:5349 read 0x33874dc thru 0x338f201 (0x7d26 bytes) 2024-09-14T07:12:52.635 INFO:teuthology.orchestra.run.smithi071.stdout:5350 punch from 0x48ab368 to 0x48afa48, (0x46e0 bytes) 2024-09-14T07:12:52.635 INFO:teuthology.orchestra.run.smithi071.stdout:5351 read 0x13d3eb5 thru 0x13e3996 (0xfae2 bytes) 2024-09-14T07:12:52.635 INFO:teuthology.orchestra.run.smithi071.stdout:5353 write 0x79b98e3 thru 0x79be39f (0x4abd bytes) 2024-09-14T07:12:52.637 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.647 INFO:teuthology.orchestra.run.smithi071.stdout:5356 trunc from 0x96f9c08 to 0x15dde0d 2024-09-14T07:12:52.649 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:52.650 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:52.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:52.681 INFO:teuthology.orchestra.run.smithi071.stdout:5358 write 0xd14f382 thru 0xd15b06e (0xbced bytes) 2024-09-14T07:12:52.685 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:12:52.699 INFO:teuthology.orchestra.run.smithi071.stdout:5360 trunc from 0xd15b06f to 0xfdf228 2024-09-14T07:12:52.714 INFO:teuthology.orchestra.run.smithi071.stdout:5361 write 0xe412ec thru 0xe4596b (0x4680 bytes) 2024-09-14T07:12:52.730 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:52.729+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:52.737 INFO:teuthology.orchestra.run.smithi071.stdout:5362 write 0xd26b14c thru 0xd26c26c (0x1121 bytes) 2024-09-14T07:12:52.740 INFO:teuthology.orchestra.run.smithi071.stdout:5363 read 0x9321b8c thru 0x932cdfe (0xb273 bytes) 2024-09-14T07:12:52.740 INFO:teuthology.orchestra.run.smithi071.stdout:5364 write 0x88388d6 thru 0x883a31d (0x1a48 bytes) 2024-09-14T07:12:52.747 INFO:teuthology.orchestra.run.smithi071.stdout:5365 trunc from 0xd26c26d to 0x9cc453d 2024-09-14T07:12:52.761 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.761 INFO:teuthology.orchestra.run.smithi071.stdout:5368 read 0x3a07a2d thru 0x3a0babb (0x408f bytes) 2024-09-14T07:12:52.761 INFO:teuthology.orchestra.run.smithi071.stdout:5370 read 0x7b2c7cd thru 0x7b306a5 (0x3ed9 bytes) 2024-09-14T07:12:52.761 INFO:teuthology.orchestra.run.smithi071.stdout:5371 trunc from 0x9cc453d to 0x9abebc7 2024-09-14T07:12:52.769 INFO:teuthology.orchestra.run.smithi071.stdout:5373 write 0x3fcac22 thru 0x3fd298b (0x7d6a bytes) 2024-09-14T07:12:52.772 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.772 INFO:teuthology.orchestra.run.smithi071.stdout:5376 punch from 0x7b5385b to 0x7b5971d, (0x5ec2 bytes) 2024-09-14T07:12:52.772 INFO:teuthology.orchestra.run.smithi071.stdout:5378 write 0x6fccd9b thru 0x6fd129d (0x4503 bytes) 2024-09-14T07:12:52.779 INFO:teuthology.orchestra.run.smithi071.stdout:5379 read 0x47758e3 thru 0x4781cd9 (0xc3f7 bytes) 2024-09-14T07:12:52.780 INFO:teuthology.orchestra.run.smithi071.stdout:5380 write 0x9518735 thru 0x95200da (0x79a6 bytes) 2024-09-14T07:12:52.786 INFO:teuthology.orchestra.run.smithi071.stdout:5381 punch from 0x7db3433 to 0x7dc1584, (0xe151 bytes) 2024-09-14T07:12:52.792 INFO:teuthology.orchestra.run.smithi071.stdout:5382 write 0xa6d0cea thru 0xa6db42c (0xa743 bytes) 2024-09-14T07:12:52.795 INFO:teuthology.orchestra.run.smithi071.stdout:5384 write 0x50c2774 thru 0x50caf1d (0x87aa bytes) 2024-09-14T07:12:52.797 INFO:teuthology.orchestra.run.smithi071.stdout:5385 write 0x6213c09 thru 0x6222820 (0xec18 bytes) 2024-09-14T07:12:52.798 INFO:teuthology.orchestra.run.smithi071.stdout:5387 write 0x2a9af4d thru 0x2aa7543 (0xc5f7 bytes) 2024-09-14T07:12:52.800 INFO:teuthology.orchestra.run.smithi071.stdout:5389 punch from 0x76b4359 to 0x76b8ff5, (0x4c9c bytes) 2024-09-14T07:12:52.810 INFO:teuthology.orchestra.run.smithi071.stdout:5390 writesame 0xdccafd5 thru 0xdcd28c9 data_size 0xb(0x78f5 bytes) 2024-09-14T07:12:52.810 INFO:teuthology.orchestra.run.smithi071.stdout:5393 write 0x4c83ff5 thru 0x4c84ebe (0xeca bytes) 2024-09-14T07:12:52.810 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:52.810 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:52.810 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:52.811 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:52.811 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:52.811 INFO:teuthology.orchestra.run.smithi071.stdout:5394 punch from 0xa3e4a83 to 0xa3e85c2, (0x3b3f bytes) 2024-09-14T07:12:52.811 INFO:teuthology.orchestra.run.smithi071.stdout:5395 writesame 0x61e3180 thru 0x61eed66 data_size 0x1(0xbbe7 bytes) 2024-09-14T07:12:52.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:52.830 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:52.830+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:52.832 INFO:teuthology.orchestra.run.smithi071.stdout:5396 write 0x156af0e thru 0x156ecfc (0x3def bytes) 2024-09-14T07:12:52.834 INFO:teuthology.orchestra.run.smithi071.stdout:5397 writesame 0x79fc39d thru 0x79fd25f data_size 0x1(0xec3 bytes) 2024-09-14T07:12:52.836 INFO:teuthology.orchestra.run.smithi071.stdout:5399 read 0x37cbdc4 thru 0x37d10a9 (0x52e6 bytes) 2024-09-14T07:12:52.836 INFO:teuthology.orchestra.run.smithi071.stdout:5400 punch from 0x3849b8d to 0x38566d7, (0xcb4a bytes) 2024-09-14T07:12:52.852 INFO:teuthology.orchestra.run.smithi071.stdout:5401 trunc from 0xdcd28ca to 0xa7ce05 2024-09-14T07:12:52.870 INFO:teuthology.orchestra.run.smithi071.stdout:5402 read 0xec6e4 thru 0xf8bbb (0xc4d8 bytes) 2024-09-14T07:12:52.891 INFO:teuthology.orchestra.run.smithi071.stdout:5403 write 0xd072140 thru 0xd07cc2e (0xaaef bytes) 2024-09-14T07:12:52.894 INFO:teuthology.orchestra.run.smithi071.stdout:5404 read 0x3d5c5f9 thru 0x3d6c206 (0xfc0e bytes) 2024-09-14T07:12:52.895 INFO:teuthology.orchestra.run.smithi071.stdout:5405 read 0x35c912a thru 0x35ca28f (0x1166 bytes) 2024-09-14T07:12:52.895 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.897 INFO:teuthology.orchestra.run.smithi071.stdout:5409 trunc from 0xd07cc2f to 0xbc3dcb3 2024-09-14T07:12:52.908 INFO:teuthology.orchestra.run.smithi071.stdout:5410 write 0xad0d58 thru 0xadbb63 (0xae0c bytes) 2024-09-14T07:12:52.911 INFO:teuthology.orchestra.run.smithi071.stdout:5411 trunc from 0xbc3dcb3 to 0xa8c5ce0 2024-09-14T07:12:52.917 INFO:teuthology.orchestra.run.smithi071.stdout:5412 read 0x7828bf6 thru 0x782ce53 (0x425e bytes) 2024-09-14T07:12:52.917 INFO:teuthology.orchestra.run.smithi071.stdout:5413 read 0x43342c9 thru 0x433e11c (0x9e54 bytes) 2024-09-14T07:12:52.918 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:52.918 INFO:teuthology.orchestra.run.smithi071.stdout:5415 punch from 0x7edcc10 to 0x7ee556f, (0x895f bytes) 2024-09-14T07:12:52.918 INFO:teuthology.orchestra.run.smithi071.stdout:5417 punch from 0x471323f to 0x471ee97, (0xbc58 bytes) 2024-09-14T07:12:52.918 INFO:teuthology.orchestra.run.smithi071.stdout:5419 read 0x7b27309 thru 0x7b30c7f (0x9977 bytes) 2024-09-14T07:12:52.918 INFO:teuthology.orchestra.run.smithi071.stdout:5421 write 0xa700495 thru 0xa70a682 (0xa1ee bytes) 2024-09-14T07:12:52.929 INFO:teuthology.orchestra.run.smithi071.stdout:5422 trunc from 0xa8c5ce0 to 0x3ac24c9 2024-09-14T07:12:52.931 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:52.930+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:52.943 INFO:teuthology.orchestra.run.smithi071.stdout:5423 read 0xdff515 thru 0xe0d98f (0xe47b bytes) 2024-09-14T07:12:52.943 INFO:teuthology.orchestra.run.smithi071.stdout:5424 read 0x15ccc71 thru 0x15d0cb2 (0x4042 bytes) 2024-09-14T07:12:52.950 INFO:teuthology.orchestra.run.smithi071.stdout:5425 trunc from 0x3ac24c9 to 0x93c78e5 2024-09-14T07:12:52.955 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:52.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.097427168999999, 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.956 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:12:52.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:12:52.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:12:52.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.962 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.097391557000002, 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:12:52.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:12:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:12:52.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.094350955000003, 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:12:52.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:12:52.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:12:52.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6096520030000008, 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.978 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:12:52.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6096332719999999, 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:12:52.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:12:52.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6095976430000007, 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:12:52.987 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:12:52.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:12:52.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:12:52.992 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6095641829999998, 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:12:52.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6095391889999995, 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:12:53.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:12:53.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6094859889999995, 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:12:53.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.007 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6094650359999996, 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:12:53.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:12:53.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6094289750000002, 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:12:53.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6078786550000004, 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:12:53.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:12:53.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6078637570000005, 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:12:53.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:12:53.028 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6078521430000006, 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:12:53.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:12:53.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:12:53.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6078291660000001, 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6077892170000005, 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.040 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:12:53.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6077675530000004, 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:12:53.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:12:53.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6077194400000003, 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.050 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:12:53.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6077062449999993, 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:12:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:12:53.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6076946329999995, 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:12:53.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:12:53.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.063 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:5426 punch from 0x31c85f3 to 0x31d4ecf, (0xc8dc bytes) 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:5427 read 0x3b992ff thru 0x3ba4b29 (0xb82b bytes) 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:5428 write 0x21031ca thru 0x2105b8e (0x29c5 bytes) 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:5429 read 0x729af80 thru 0x72aac8e (0xfd0f bytes) 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:5431 read 0x4c8b253 thru 0x4c90e50 (0x5bfe bytes) 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:53.065 INFO:teuthology.orchestra.run.smithi071.stdout:5433 punch from 0x8705ee0 to 0x870bae3, (0x5c03 bytes) 2024-09-14T07:12:53.066 INFO:teuthology.orchestra.run.smithi071.stdout:5434 read 0xad70a6 thru 0xad7126 (0x81 bytes) 2024-09-14T07:12:53.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:53.068 INFO:teuthology.orchestra.run.smithi071.stdout:5435 write 0xda684be thru 0xda77387 (0xeeca bytes) 2024-09-14T07:12:53.068 INFO:teuthology.orchestra.run.smithi071.stdout:5438 trunc from 0xda77388 to 0x8d743e2 2024-09-14T07:12:53.068 INFO:teuthology.orchestra.run.smithi071.stdout:5440 writesame 0xbbd594c thru 0xbbe0a44 data_size 0x55(0xb0f9 bytes) 2024-09-14T07:12:53.068 INFO:teuthology.orchestra.run.smithi071.stdout:5441 read 0xb875d49 thru 0xb87b534 (0x57ec bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5442 writesame 0x523aab9 thru 0x52490fc data_size 0x2(0xe644 bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5443 write 0xe9570d4 thru 0xe95f6cb (0x85f8 bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5444 write 0x894c304 thru 0x89506ff (0x43fc bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5445 read 0xc0e4fc9 thru 0xc0e6c3e (0x1c76 bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5446 write 0xdb28657 thru 0xdb2ee99 (0x6843 bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5448 writesame 0xa050999 thru 0xa05dd6a data_size 0x13(0xd3d2 bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5449 write 0xeb9855a thru 0xeb9b978 (0x341f bytes) 2024-09-14T07:12:53.069 INFO:teuthology.orchestra.run.smithi071.stdout:5450 trunc from 0xeb9b979 to 0x1ff3815 2024-09-14T07:12:53.070 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:53.064+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:53.100 INFO:teuthology.orchestra.run.smithi071.stdout:5451 writesame 0xd1a85ab thru 0xd1ab75d data_size 0x1(0x31b3 bytes) 2024-09-14T07:12:53.101 INFO:teuthology.orchestra.run.smithi071.stdout:5453 read 0x29c2d4 thru 0x2a5d94 (0x9ac1 bytes) 2024-09-14T07:12:53.101 INFO:teuthology.orchestra.run.smithi071.stdout:5455 write 0x94f6e14 thru 0x95061ef (0xf3dc bytes) 2024-09-14T07:12:53.103 INFO:teuthology.orchestra.run.smithi071.stdout:5457 punch from 0x78dc39c to 0x78eba37, (0xf69b bytes) 2024-09-14T07:12:53.104 INFO:teuthology.orchestra.run.smithi071.stdout:5459 trunc from 0xd1ab75e to 0xcb2e68b 2024-09-14T07:12:53.110 INFO:teuthology.orchestra.run.smithi071.stdout:5460 write 0x7fdc42a thru 0x7fe7b6c (0xb743 bytes) 2024-09-14T07:12:53.115 INFO:teuthology.orchestra.run.smithi071.stdout:5466 write 0xa4e8f7f thru 0xa4f666d (0xd6ef bytes) 2024-09-14T07:12:53.121 INFO:teuthology.orchestra.run.smithi071.stdout:5467 writesame 0xacc44d thru 0xace374 data_size 0x4(0x1f28 bytes) 2024-09-14T07:12:53.129 INFO:teuthology.orchestra.run.smithi071.stdout:5468 writesame 0xd08aa52 thru 0xd090451 data_size 0xa(0x5a00 bytes) 2024-09-14T07:12:53.129 INFO:teuthology.orchestra.run.smithi071.stdout:5469 writesame 0x1b921a8 thru 0x1b93f71 data_size 0x6(0x1dca bytes) 2024-09-14T07:12:53.130 INFO:teuthology.orchestra.run.smithi071.stdout:5471 writesame 0x104feb5 thru 0x10571c1 data_size 0x1(0x730d bytes) 2024-09-14T07:12:53.146 INFO:teuthology.orchestra.run.smithi071.stdout:5472 punch from 0x61ee7ce to 0x61f70fe, (0x8930 bytes) 2024-09-14T07:12:53.146 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:53.147 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:53.147 INFO:teuthology.orchestra.run.smithi071.stdout:5475 write 0x4b35a53 thru 0x4b42f5c (0xd50a bytes) 2024-09-14T07:12:53.148 INFO:teuthology.orchestra.run.smithi071.stdout:5476 write 0xbceffa0 thru 0xbcfdb43 (0xdba4 bytes) 2024-09-14T07:12:53.149 INFO:teuthology.orchestra.run.smithi071.stdout:5478 read 0x48250c8 thru 0x482be2c (0x6d65 bytes) 2024-09-14T07:12:53.149 INFO:teuthology.orchestra.run.smithi071.stdout:5479 read 0x32433df thru 0x3249f5a (0x6b7c bytes) 2024-09-14T07:12:53.150 INFO:teuthology.orchestra.run.smithi071.stdout:5480 write 0xbe6a504 thru 0xbe6daaf (0x35ac bytes) 2024-09-14T07:12:53.151 INFO:teuthology.orchestra.run.smithi071.stdout:5482 read 0x270c8a9 thru 0x2715e4e (0x95a6 bytes) 2024-09-14T07:12:53.151 INFO:teuthology.orchestra.run.smithi071.stdout:5484 write 0x969ee3a thru 0x96a1105 (0x22cc bytes) 2024-09-14T07:12:53.155 INFO:teuthology.orchestra.run.smithi071.stdout:5485 read 0xaabf5ec thru 0xaac6125 (0x6b3a bytes) 2024-09-14T07:12:53.155 INFO:teuthology.orchestra.run.smithi071.stdout:5486 punch from 0x6930fd1 to 0x6936bd5, (0x5c04 bytes) 2024-09-14T07:12:53.155 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:53.155 INFO:teuthology.orchestra.run.smithi071.stdout:5490 writesame 0xbbac8f9 thru 0xbbb69d3 data_size 0x1(0xa0db bytes) 2024-09-14T07:12:53.165 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:53.164+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:53.168 INFO:teuthology.orchestra.run.smithi071.stdout:5491 punch from 0x54f5259 to 0x54fe83d, (0x95e4 bytes) 2024-09-14T07:12:53.168 INFO:teuthology.orchestra.run.smithi071.stdout:5492 write 0xadcbaef thru 0xadccdc3 (0x12d5 bytes) 2024-09-14T07:12:53.174 INFO:teuthology.orchestra.run.smithi071.stdout:5493 writesame 0xd2ca2e3 thru 0xd2cbbc7 data_size 0x1(0x18e5 bytes) 2024-09-14T07:12:53.175 INFO:teuthology.orchestra.run.smithi071.stdout:5495 write 0xd24bb2e thru 0xd2552aa (0x977d bytes) 2024-09-14T07:12:53.178 INFO:teuthology.orchestra.run.smithi071.stdout:5496 write 0x7dda3e8 thru 0x7de821e (0xde37 bytes) 2024-09-14T07:12:53.180 INFO:teuthology.orchestra.run.smithi071.stdout:5497 read 0x8d89d2d thru 0x8d89d69 (0x3d bytes) 2024-09-14T07:12:53.180 INFO:teuthology.orchestra.run.smithi071.stdout:5498 clone 34 order 23 su 2097152 sc 11 2024-09-14T07:12:53.211 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:53.211 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:53.211 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:53.211 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:53.220 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:53.304 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:53.303+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:53.363 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:53.363 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:53.363 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:53.363 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:53.363 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:53.369 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:53.369+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:53.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:53.470 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:53.469+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:53.517 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:53.517 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:53.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:53.517 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480658013999999, 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:12:53.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:12:53.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:12:53.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480632541999999, 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:12:53.522 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:12:53.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:12:53.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480620868999999, 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:12:53.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480610093999999, 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:12:53.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:12:53.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480599553000001, 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:12:53.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480589084999998, 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:12:53.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480578572999999, 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:12:53.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480568235, 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:53.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:12:53.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480557892, 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:12:53.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:12:53.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480539304000001, 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:12:53.557 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:12:53.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.561 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480528214, 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:12:53.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:12:53.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480517511999999, 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.566 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:53.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.570 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480496763000001, 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:12:53.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:12:53.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:53.575 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480470902, 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:12:53.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480451066000001, 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:12:53.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:12:53.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480425443000001, 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:12:53.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:12:53.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480386633999998, 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:53.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.480365965000001, 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:12:53.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:12:53.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.475005034999999, 2024-09-14T07:12:53.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:12:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.474990480999999, 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:12:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:12:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:53.607 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:53.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:53.609 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:53.608+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:53.686 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:12:53.709 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:53.708+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:53.761 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:53.761 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:53.761 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:53.761 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:53.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:53.810 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:53.809+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:53.884 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:53.884 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:53.884 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:53.884 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:53.884 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:53.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:53.901 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-14T07:12:53.910 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:53.910+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:54.007 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.239206580999998, 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.238107692, 2024-09-14T07:12:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.211264532999998, 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.197970527999999, 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.197901113999997, 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.357523088999997, 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.181931851000002, 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:12:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:12:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.891866954999998, 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:12:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:12:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.887838657000003, 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:12:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:12:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.666839533999998, 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:12:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:12:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.663321723000003, 2024-09-14T07:12:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:12:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:71337 3.9 e64/23 3:9465e89a:::rbd_data.118266971d4e.0000000000000124:head v 64'216, mlcod=63'214)", 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.66194301, 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003270069, 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344128+0000", 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8999999999999995e-07 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344145+0000", 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7317999999999999e-05 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344156+0000", 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1374e-05 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344163+0000", 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3169999999999998e-06 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344209+0000", 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6301999999999998e-05 2024-09-14T07:12:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344224+0000", 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5418999999999999e-05 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347364+0000", 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031395490000000002 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347397+0000", 2024-09-14T07:12:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.29e-05 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.193182742999999, 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:12:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.540819403, 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:12:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.2023209619999999, 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:12:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:12:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1966730590000001, 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:12:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:12:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.4591863759999999, 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:12:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:12:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.2313004750000001, 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.97860370100000005, 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:12:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:12:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:12:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:12:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.93665609100000002, 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:12:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:54.192 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:54.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:54.196 INFO:teuthology.orchestra.run.smithi071.stdout:5499 read 0x4ec632b thru 0x4ec96b0 (0x3386 bytes) 2024-09-14T07:12:54.196 INFO:teuthology.orchestra.run.smithi071.stdout:5500 punch from 0xc6aace5 to 0xc6aeea0, (0x41bb bytes) 2024-09-14T07:12:54.196 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.196 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.196 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5505 write 0xa4a7cd9 thru 0xa4a815a (0x482 bytes) 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5506 trunc from 0xd2cbbc8 to 0x6d33b8b 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5507 writesame 0x31bf4ea thru 0x31c2fcf data_size 0x15(0x3ae6 bytes) 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5508 trunc from 0x6d33b8b to 0x6a6bc43 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5509 trunc from 0x6a6bc43 to 0xe180886 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5514 punch from 0x540c6bf to 0x540d9cd, (0x130e bytes) 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5515 write 0x4884cf0 thru 0x4886a36 (0x1d47 bytes) 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5516 read 0x59febc8 thru 0x5a048b6 (0x5cef bytes) 2024-09-14T07:12:54.197 INFO:teuthology.orchestra.run.smithi071.stdout:5517 read 0x99c8e47 thru 0x99d4d4e (0xbf08 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5518 punch from 0x70d92f6 to 0x70e443a, (0xb144 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5520 write 0x7b2057c thru 0x7b2c050 (0xbad5 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5521 writesame 0xdc42740 thru 0xdc4796a data_size 0x7(0x522b bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5522 read 0x1ef6ca4 thru 0x1efe88b (0x7be8 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5524 punch from 0xcc87368 to 0xcc8d60b, (0x62a3 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5526 read 0x5fb9c34 thru 0x5fc8b6f (0xef3c bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5527 write 0x334a4f2 thru 0x334bb52 (0x1661 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5528 punch from 0xc2489a6 to 0xc24b351, (0x29ab bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5529 trunc from 0xe180886 to 0x8639d86 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5530 punch from 0x76e97e3 to 0x76ed414, (0x3c31 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5532 punch from 0x46bebc to 0x4742dd, (0x8421 bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5533 punch from 0x3a714aa to 0x3a78c56, (0x77ac bytes) 2024-09-14T07:12:54.198 INFO:teuthology.orchestra.run.smithi071.stdout:5534 read 0x285ade4 thru 0x2866fd0 (0xc1ed bytes) 2024-09-14T07:12:54.199 INFO:teuthology.orchestra.run.smithi071.stdout:5535 write 0xd24387a thru 0xd248313 (0x4a9a bytes) 2024-09-14T07:12:54.199 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:54.192+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:54.199 INFO:teuthology.orchestra.run.smithi071.stdout:5537 writesame 0x504cc9b thru 0x5057568 data_size 0x3e(0xa8ce bytes) 2024-09-14T07:12:54.201 INFO:teuthology.orchestra.run.smithi071.stdout:5538 read 0x2b031d7 thru 0x2b0e219 (0xb043 bytes) 2024-09-14T07:12:54.207 INFO:teuthology.orchestra.run.smithi071.stdout:5539 write 0xdb85b0d thru 0xdb8e168 (0x865c bytes) 2024-09-14T07:12:54.217 INFO:teuthology.orchestra.run.smithi071.stdout:5542 trunc from 0xdb8e169 to 0x70056f1 2024-09-14T07:12:54.239 INFO:teuthology.orchestra.run.smithi071.stdout:5543 trunc from 0x70056f1 to 0xecd7829 2024-09-14T07:12:54.246 INFO:teuthology.orchestra.run.smithi071.stdout:5544 writesame 0xc038ab9 thru 0xc0393cd data_size 0x1(0x915 bytes) 2024-09-14T07:12:54.249 INFO:teuthology.orchestra.run.smithi071.stdout:5546 read 0xbeb7682 thru 0xbec23a9 (0xad28 bytes) 2024-09-14T07:12:54.263 INFO:teuthology.orchestra.run.smithi071.stdout:5547 trunc from 0xecd7829 to 0x2fa530d 2024-09-14T07:12:54.295 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:54.294+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:54.309 INFO:teuthology.orchestra.run.smithi071.stdout:5548 write 0x42e5b6f thru 0x42ea15d (0x45ef bytes) 2024-09-14T07:12:54.310 INFO:teuthology.orchestra.run.smithi071.stdout:5549 punch from 0x3e92288 to 0x3e9b77e, (0x94f6 bytes) 2024-09-14T07:12:54.332 INFO:teuthology.orchestra.run.smithi071.stdout:5550 write 0xe0c1474 thru 0xe0cb033 (0x9bc0 bytes) 2024-09-14T07:12:54.334 INFO:teuthology.orchestra.run.smithi071.stdout:5551 write 0x5970fa4 thru 0x5980473 (0xf4d0 bytes) 2024-09-14T07:12:54.337 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:54.337 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:54.337 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:54.337 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:54.338 INFO:teuthology.orchestra.run.smithi071.stdout:5553 read 0x79ddc1e thru 0x79e0901 (0x2ce4 bytes) 2024-09-14T07:12:54.338 INFO:teuthology.orchestra.run.smithi071.stdout:5554 read 0x2394c4b thru 0x2399de8 (0x519e bytes) 2024-09-14T07:12:54.339 INFO:teuthology.orchestra.run.smithi071.stdout:5556 read 0xc819ce4 thru 0xc81ce6d (0x318a bytes) 2024-09-14T07:12:54.339 INFO:teuthology.orchestra.run.smithi071.stdout:5558 read 0x565567d thru 0x565e7b3 (0x9137 bytes) 2024-09-14T07:12:54.350 INFO:teuthology.orchestra.run.smithi071.stdout:5559 trunc from 0xe0cb034 to 0x5918633 2024-09-14T07:12:54.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:54.362 INFO:teuthology.orchestra.run.smithi071.stdout:5562 read 0x48284c3 thru 0x4837403 (0xef41 bytes) 2024-09-14T07:12:54.362 INFO:teuthology.orchestra.run.smithi071.stdout:5564 read 0x282fa6c thru 0x2839b00 (0xa095 bytes) 2024-09-14T07:12:54.362 INFO:teuthology.orchestra.run.smithi071.stdout:5565 read 0x4dcc338 thru 0x4ddb560 (0xf229 bytes) 2024-09-14T07:12:54.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:54.371 INFO:teuthology.orchestra.run.smithi071.stdout:5566 write 0x74ea26d thru 0x74f37ec (0x9580 bytes) 2024-09-14T07:12:54.374 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.375 INFO:teuthology.orchestra.run.smithi071.stdout:5568 write 0x29c3acd thru 0x29d21cf (0xe703 bytes) 2024-09-14T07:12:54.376 INFO:teuthology.orchestra.run.smithi071.stdout:5570 trunc from 0x74f37ed to 0x717346c 2024-09-14T07:12:54.383 INFO:teuthology.orchestra.run.smithi071.stdout:5571 read 0xba6796 thru 0xbaab11 (0x437c bytes) 2024-09-14T07:12:54.383 INFO:teuthology.orchestra.run.smithi071.stdout:5572 write 0x40ff0d thru 0x41fd42 (0xfe36 bytes) 2024-09-14T07:12:54.385 INFO:teuthology.orchestra.run.smithi071.stdout:5573 writesame 0x338e15e thru 0x3393b96 data_size 0x1(0x5a39 bytes) 2024-09-14T07:12:54.395 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:54.395+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:54.399 INFO:teuthology.orchestra.run.smithi071.stdout:5574 trunc from 0x717346c to 0x7247ffc 2024-09-14T07:12:54.404 INFO:teuthology.orchestra.run.smithi071.stdout:5575 punch from 0x5362fbe to 0x5365097, (0x20d9 bytes) 2024-09-14T07:12:54.404 INFO:teuthology.orchestra.run.smithi071.stdout:5576 write 0x52455ae thru 0x5250b0a (0xb55d bytes) 2024-09-14T07:12:54.405 INFO:teuthology.orchestra.run.smithi071.stdout:5577 read 0x2b6ae40 thru 0x2b79170 (0xe331 bytes) 2024-09-14T07:12:54.406 INFO:teuthology.orchestra.run.smithi071.stdout:5578 write 0x122ddf3 thru 0x1237111 (0x931f bytes) 2024-09-14T07:12:54.409 INFO:teuthology.orchestra.run.smithi071.stdout:5579 trunc from 0x7247ffc to 0x512ba06 2024-09-14T07:12:54.433 INFO:teuthology.orchestra.run.smithi071.stdout:5580 write 0xa130e97 thru 0xa1402c0 (0xf42a bytes) 2024-09-14T07:12:54.436 INFO:teuthology.orchestra.run.smithi071.stdout:5583 write 0x3747c67 thru 0x3754cad (0xd047 bytes) 2024-09-14T07:12:54.437 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.437 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.441 INFO:teuthology.orchestra.run.smithi071.stdout:5586 trunc from 0xa1402c1 to 0x74dad41 2024-09-14T07:12:54.452 INFO:teuthology.orchestra.run.smithi071.stdout:5587 trunc from 0x74dad41 to 0xb8478c1 2024-09-14T07:12:54.458 INFO:teuthology.orchestra.run.smithi071.stdout:5588 punch from 0xa1a3f8b to 0xa1acc07, (0x8c7c bytes) 2024-09-14T07:12:54.458 INFO:teuthology.orchestra.run.smithi071.stdout:5589 read 0x44ab687 thru 0x44abebb (0x835 bytes) 2024-09-14T07:12:54.458 INFO:teuthology.orchestra.run.smithi071.stdout:5590 write 0x598ae29 thru 0x5997b3c (0xcd14 bytes) 2024-09-14T07:12:54.461 INFO:teuthology.orchestra.run.smithi071.stdout:5591 read 0x4d1b165 thru 0x4d1b6f5 (0x591 bytes) 2024-09-14T07:12:54.461 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.461 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.462 INFO:teuthology.orchestra.run.smithi071.stdout:5594 write 0x307a78 thru 0x30f72f (0x7cb8 bytes) 2024-09-14T07:12:54.463 INFO:teuthology.orchestra.run.smithi071.stdout:5598 read 0xabfcb5 thru 0xac78ce (0x7c1a bytes) 2024-09-14T07:12:54.463 INFO:teuthology.orchestra.run.smithi071.stdout:5600 writesame 0x25a983f thru 0x25ac775 data_size 0x33(0x2f37 bytes) 2024-09-14T07:12:54.465 INFO:teuthology.orchestra.run.smithi071.stdout:5601 read 0x5e2e7d6 thru 0x5e32e2d (0x4658 bytes) 2024-09-14T07:12:54.469 INFO:teuthology.orchestra.run.smithi071.stdout:5604 trunc from 0xb8478c1 to 0xea58110 2024-09-14T07:12:54.475 INFO:teuthology.orchestra.run.smithi071.stdout:5605 read 0x2699e52 thru 0x26a3b48 (0x9cf7 bytes) 2024-09-14T07:12:54.476 INFO:teuthology.orchestra.run.smithi071.stdout:5606 write 0x46ca64c thru 0x46d7451 (0xce06 bytes) 2024-09-14T07:12:54.478 INFO:teuthology.orchestra.run.smithi071.stdout:5609 read 0x962d826 thru 0x963c88c (0xf067 bytes) 2024-09-14T07:12:54.478 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.478 INFO:teuthology.orchestra.run.smithi071.stdout:5613 read 0x910bfc7 thru 0x9110e0a (0x4e44 bytes) 2024-09-14T07:12:54.478 INFO:teuthology.orchestra.run.smithi071.stdout:5614 writesame 0x1084aa2 thru 0x1094a31 data_size 0x74(0xff90 bytes) 2024-09-14T07:12:54.479 INFO:teuthology.orchestra.run.smithi071.stdout:5615 write 0x4034afa thru 0x403e7a6 (0x9cad bytes) 2024-09-14T07:12:54.480 INFO:teuthology.orchestra.run.smithi071.stdout:5616 writesame 0xb1c2394 thru 0xb1c27ec data_size 0x7(0x459 bytes) 2024-09-14T07:12:54.481 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:54.481 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:54.481 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:54.481 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:54.481 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:54.483 INFO:teuthology.orchestra.run.smithi071.stdout:5617 punch from 0x49bd34e to 0x49c72b8, (0x9f6a bytes) 2024-09-14T07:12:54.483 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.483 INFO:teuthology.orchestra.run.smithi071.stdout:5619 writesame 0xea21ab9 thru 0xea2eab8 data_size 0x80(0xd000 bytes) 2024-09-14T07:12:54.487 INFO:teuthology.orchestra.run.smithi071.stdout:5620 punch from 0x5e57e94 to 0x5e58f6c, (0x10d8 bytes) 2024-09-14T07:12:54.487 INFO:teuthology.orchestra.run.smithi071.stdout:5621 read 0x40e29a thru 0x41dbd1 (0xf938 bytes) 2024-09-14T07:12:54.487 INFO:teuthology.orchestra.run.smithi071.stdout:5622 write 0x4a4be77 thru 0x4a521e1 (0x636b bytes) 2024-09-14T07:12:54.489 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.489 INFO:teuthology.orchestra.run.smithi071.stdout:5625 write 0x92e2ca2 thru 0x92ea45c (0x77bb bytes) 2024-09-14T07:12:54.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:54.498 INFO:teuthology.orchestra.run.smithi071.stdout:5626 write 0xeb143d5 thru 0xeb1c4ee (0x811a bytes) 2024-09-14T07:12:54.499 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:54.497+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:54.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:54.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:54.507 INFO:teuthology.orchestra.run.smithi071.stdout:5627 trunc from 0xeb1c4ef to 0x957d306 2024-09-14T07:12:54.518 INFO:teuthology.orchestra.run.smithi071.stdout:5628 trunc from 0x957d306 to 0x9021fb3 2024-09-14T07:12:54.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:54.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:54.526 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.526 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.526 INFO:teuthology.orchestra.run.smithi071.stdout:5631 read 0x24f828 thru 0x25ecbc (0xf495 bytes) 2024-09-14T07:12:54.534 INFO:teuthology.orchestra.run.smithi071.stdout:5634 trunc from 0x9021fb3 to 0x2f9d911 2024-09-14T07:12:54.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:54.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:54.547 INFO:teuthology.orchestra.run.smithi071.stdout:5636 punch from 0xd17de0 to 0xd20a07, (0x8c27 bytes) 2024-09-14T07:12:54.547 INFO:teuthology.orchestra.run.smithi071.stdout:5637 punch from 0x110d783 to 0x110ec3d, (0x14ba bytes) 2024-09-14T07:12:54.549 INFO:teuthology.orchestra.run.smithi071.stdout:5638 trunc from 0x2f9d911 to 0x45e84fe 2024-09-14T07:12:54.554 INFO:teuthology.orchestra.run.smithi071.stdout:5639 trunc from 0x45e84fe to 0x44530cc 2024-09-14T07:12:54.560 INFO:teuthology.orchestra.run.smithi071.stdout:5640 read 0x18c9ef9 thru 0x18d5ccf (0xbdd7 bytes) 2024-09-14T07:12:54.561 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.563 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:54.564 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:54.570 INFO:teuthology.orchestra.run.smithi071.stdout:5643 trunc from 0x44530cc to 0xbb38eee 2024-09-14T07:12:54.576 INFO:teuthology.orchestra.run.smithi071.stdout:5645 writesame 0x1fb12e5 thru 0x1fbd558 data_size 0x83(0xc274 bytes) 2024-09-14T07:12:54.577 INFO:teuthology.orchestra.run.smithi071.stdout:5646 writesame 0xa2c9cfd thru 0xa2d65ff data_size 0x3(0xc903 bytes) 2024-09-14T07:12:54.586 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:54.587 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:54.589 INFO:teuthology.orchestra.run.smithi071.stdout:5647 writesame 0xc0568e thru 0xc08af5 data_size 0x4e(0x3468 bytes) 2024-09-14T07:12:54.597 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:54.596+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:54.597 INFO:teuthology.orchestra.run.smithi071.stdout:5648 write 0xd35bd26 thru 0xd361c22 (0x5efd bytes) 2024-09-14T07:12:54.601 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.601 INFO:teuthology.orchestra.run.smithi071.stdout:5651 write 0x93f0de1 thru 0x93f4560 (0x3780 bytes) 2024-09-14T07:12:54.605 INFO:teuthology.orchestra.run.smithi071.stdout:5652 read 0x722e6f2 thru 0x7234dd0 (0x66df bytes) 2024-09-14T07:12:54.607 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:54.607 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:54.611 INFO:teuthology.orchestra.run.smithi071.stdout:5653 trunc from 0xd361c23 to 0x8b7d4a7 2024-09-14T07:12:54.623 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:54.623 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:54.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:54.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:54.631 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:54.632 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:54.634 INFO:teuthology.orchestra.run.smithi071.stdout:5654 write 0xbf325dc thru 0xbf36025 (0x3a4a bytes) 2024-09-14T07:12:54.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:54.646 INFO:teuthology.orchestra.run.smithi071.stdout:5655 write 0xe0ac245 thru 0xe0b3cdc (0x7a98 bytes) 2024-09-14T07:12:54.649 INFO:teuthology.orchestra.run.smithi071.stdout:5658 writesame 0x217fbd0 thru 0x218ce52 data_size 0x1(0xd283 bytes) 2024-09-14T07:12:54.675 INFO:teuthology.orchestra.run.smithi071.stdout:5659 writesame 0x55fffa9 thru 0x56051d8 data_size 0x28(0x5230 bytes) 2024-09-14T07:12:54.677 INFO:teuthology.orchestra.run.smithi071.stdout:5660 writesame 0x7b0457e thru 0x7b11f33 data_size 0x15(0xd9b6 bytes) 2024-09-14T07:12:54.680 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.689 INFO:teuthology.orchestra.run.smithi071.stdout:5665 trunc from 0xe0b3cdd to 0x71103e2 2024-09-14T07:12:54.698 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:54.697+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:54.712 INFO:teuthology.orchestra.run.smithi071.stdout:5667 write 0xab7cd59 thru 0xab7e643 (0x18eb bytes) 2024-09-14T07:12:54.724 INFO:teuthology.orchestra.run.smithi071.stdout:5668 write 0xdd5df56 thru 0xdd6695c (0x8a07 bytes) 2024-09-14T07:12:54.727 INFO:teuthology.orchestra.run.smithi071.stdout:5669 write 0x529da00 thru 0x52a6979 (0x8f7a bytes) 2024-09-14T07:12:54.729 INFO:teuthology.orchestra.run.smithi071.stdout:5670 writesame 0x77fa710 thru 0x7807df1 data_size 0x5(0xd6e2 bytes) 2024-09-14T07:12:54.734 INFO:teuthology.orchestra.run.smithi071.stdout:5671 writesame 0x2178759 thru 0x217e823 data_size 0x1(0x60cb bytes) 2024-09-14T07:12:54.743 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:54.743 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:54.746 INFO:teuthology.orchestra.run.smithi071.stdout:5673 punch from 0xba7ff70 to 0xba8e457, (0xe4e7 bytes) 2024-09-14T07:12:54.746 INFO:teuthology.orchestra.run.smithi071.stdout:5674 write 0x2277265 thru 0x22777e9 (0x585 bytes) 2024-09-14T07:12:54.751 INFO:teuthology.orchestra.run.smithi071.stdout:5675 trunc from 0xdd6695d to 0xb00d6c5 2024-09-14T07:12:54.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:54.758 INFO:teuthology.orchestra.run.smithi071.stdout:5676 write 0xaf3d8fa thru 0xaf49493 (0xbb9a bytes) 2024-09-14T07:12:54.762 INFO:teuthology.orchestra.run.smithi071.stdout:5677 read 0x6b6e087 thru 0x6b783c1 (0xa33b bytes) 2024-09-14T07:12:54.762 INFO:teuthology.orchestra.run.smithi071.stdout:5678 read 0x30aef88 thru 0x30b970e (0xa787 bytes) 2024-09-14T07:12:54.771 INFO:teuthology.orchestra.run.smithi071.stdout:5680 writesame 0xdf64d57 thru 0xdf71785 data_size 0x9(0xca2f bytes) 2024-09-14T07:12:54.771 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.771 INFO:teuthology.orchestra.run.smithi071.stdout:5683 punch from 0x9dfcdda to 0x9e0aee3, (0xe109 bytes) 2024-09-14T07:12:54.784 INFO:teuthology.orchestra.run.smithi071.stdout:5684 trunc from 0xdf71786 to 0x2c4e90e 2024-09-14T07:12:54.799 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:54.798+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:54.800 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.812 INFO:teuthology.orchestra.run.smithi071.stdout:5686 write 0x842e648 thru 0x843c46c (0xde25 bytes) 2024-09-14T07:12:54.815 INFO:teuthology.orchestra.run.smithi071.stdout:5687 punch from 0xa479cd to 0xa50260, (0x8893 bytes) 2024-09-14T07:12:54.815 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.815 INFO:teuthology.orchestra.run.smithi071.stdout:5689 read 0x45bfc80 thru 0x45c13b4 (0x1735 bytes) 2024-09-14T07:12:54.815 INFO:teuthology.orchestra.run.smithi071.stdout:5690 write 0x817ffdc thru 0x8184111 (0x4136 bytes) 2024-09-14T07:12:54.818 INFO:teuthology.orchestra.run.smithi071.stdout:5692 read 0x64a83ea thru 0x64ad635 (0x524c bytes) 2024-09-14T07:12:54.826 INFO:teuthology.orchestra.run.smithi071.stdout:5694 write 0xabd3366 thru 0xabdd4dd (0xa178 bytes) 2024-09-14T07:12:54.837 INFO:teuthology.orchestra.run.smithi071.stdout:5696 trunc from 0xabdd4de to 0x3aa3383 2024-09-14T07:12:54.852 INFO:teuthology.orchestra.run.smithi071.stdout:5697 trunc from 0x3aa3383 to 0x76213ad 2024-09-14T07:12:54.857 INFO:teuthology.orchestra.run.smithi071.stdout:5699 read 0x47e0a0f thru 0x47ed05b (0xc64d bytes) 2024-09-14T07:12:54.858 INFO:teuthology.orchestra.run.smithi071.stdout:5700 read 0x15260b4 thru 0x1534c31 (0xeb7e bytes) 2024-09-14T07:12:54.858 INFO:teuthology.orchestra.run.smithi071.stdout:5701 write 0xfe6336 thru 0xff2338 (0xc003 bytes) 2024-09-14T07:12:54.859 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:54.859 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:54.866 INFO:teuthology.orchestra.run.smithi071.stdout:5702 write 0x85678af thru 0x856a44d (0x2b9f bytes) 2024-09-14T07:12:54.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:54.869 INFO:teuthology.orchestra.run.smithi071.stdout:5705 writesame 0x19296fb thru 0x19307d2 data_size 0x2e(0x70d8 bytes) 2024-09-14T07:12:54.871 INFO:teuthology.orchestra.run.smithi071.stdout:5706 read 0x6e237da thru 0x6e253e5 (0x1c0c bytes) 2024-09-14T07:12:54.871 INFO:teuthology.orchestra.run.smithi071.stdout:5707 punch from 0x24609dc to 0x246dc79, (0xd29d bytes) 2024-09-14T07:12:54.871 INFO:teuthology.orchestra.run.smithi071.stdout:5708 read 0x3a3dc8 thru 0x3b38a4 (0xfadd bytes) 2024-09-14T07:12:54.871 INFO:teuthology.orchestra.run.smithi071.stdout:5710 flatten 2024-09-14T07:12:54.876 INFO:teuthology.orchestra.run.smithi071.stdout:5711 punch from 0x3d85da6 to 0x3d94ca9, (0xef03 bytes) 2024-09-14T07:12:54.876 INFO:teuthology.orchestra.run.smithi071.stdout:5712 read 0x7d240aa thru 0x7d29105 (0x505c bytes) 2024-09-14T07:12:54.877 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.877 INFO:teuthology.orchestra.run.smithi071.stdout:5714 punch from 0x6dfe679 to 0x6e0be73, (0xd7fa bytes) 2024-09-14T07:12:54.877 INFO:teuthology.orchestra.run.smithi071.stdout:5715 read 0x5231be5 thru 0x523c602 (0xaa1e bytes) 2024-09-14T07:12:54.877 INFO:teuthology.orchestra.run.smithi071.stdout:5716 read 0x74d61d4 thru 0x74e4d40 (0xeb6d bytes) 2024-09-14T07:12:54.877 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.883 INFO:teuthology.orchestra.run.smithi071.stdout:5720 write 0x904c292 thru 0x9056a1b (0xa78a bytes) 2024-09-14T07:12:54.885 INFO:teuthology.orchestra.run.smithi071.stdout:5721 read 0x4e2ac19 thru 0x4e301cf (0x55b7 bytes) 2024-09-14T07:12:54.890 INFO:teuthology.orchestra.run.smithi071.stdout:5723 trunc from 0x9056a1c to 0x5524d83 2024-09-14T07:12:54.899 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:54.899+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:54.908 INFO:teuthology.orchestra.run.smithi071.stdout:5724 trunc from 0x5524d83 to 0xb0e0c7e 2024-09-14T07:12:54.913 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.921 INFO:teuthology.orchestra.run.smithi071.stdout:5726 write 0xca3e7c5 thru 0xca40d26 (0x2562 bytes) 2024-09-14T07:12:54.923 INFO:teuthology.orchestra.run.smithi071.stdout:5727 write 0x9dde471 thru 0x9ddf94b (0x14db bytes) 2024-09-14T07:12:54.926 INFO:teuthology.orchestra.run.smithi071.stdout:5728 read 0xc3e824e thru 0xc3eba8c (0x383f bytes) 2024-09-14T07:12:54.926 INFO:teuthology.orchestra.run.smithi071.stdout:5730 writesame 0x718d0a thru 0x71b548 data_size 0x1(0x283f bytes) 2024-09-14T07:12:54.931 INFO:teuthology.orchestra.run.smithi071.stdout:5732 write 0x17b8ba4 thru 0x17bd54c (0x49a9 bytes) 2024-09-14T07:12:54.933 INFO:teuthology.orchestra.run.smithi071.stdout:5734 read 0x96e41dd thru 0x96ef979 (0xb79d bytes) 2024-09-14T07:12:54.941 INFO:teuthology.orchestra.run.smithi071.stdout:5737 write 0xd7be5b1 thru 0xd7cbfe4 (0xda34 bytes) 2024-09-14T07:12:54.943 INFO:teuthology.orchestra.run.smithi071.stdout:5738 read 0x8964a96 thru 0x896f50c (0xaa77 bytes) 2024-09-14T07:12:54.944 INFO:teuthology.orchestra.run.smithi071.stdout:5739 read 0xc32528a thru 0xc3278a8 (0x261f bytes) 2024-09-14T07:12:54.944 INFO:teuthology.orchestra.run.smithi071.stdout:5741 writesame 0x9d7d903 thru 0x9d86c3f data_size 0x1(0x933d bytes) 2024-09-14T07:12:54.962 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:54.962 INFO:teuthology.orchestra.run.smithi071.stdout:5744 read 0xc6a631a thru 0xc6ab0cc (0x4db3 bytes) 2024-09-14T07:12:54.963 INFO:teuthology.orchestra.run.smithi071.stdout:5745 trunc from 0xd7cbfe5 to 0xc794d3a 2024-09-14T07:12:54.969 INFO:teuthology.orchestra.run.smithi071.stdout:5746 read 0x10391b4 thru 0x103b5e6 (0x2433 bytes) 2024-09-14T07:12:54.974 INFO:teuthology.orchestra.run.smithi071.stdout:5747 trunc from 0xc794d3a to 0x90e64fe 2024-09-14T07:12:54.986 INFO:teuthology.orchestra.run.smithi071.stdout:5748 read 0x4d7b18b thru 0x4d8465a (0x94d0 bytes) 2024-09-14T07:12:54.987 INFO:teuthology.orchestra.run.smithi071.stdout:5749 punch from 0x7e222c to 0x7e8123, (0x5ef7 bytes) 2024-09-14T07:12:54.987 INFO:teuthology.orchestra.run.smithi071.stdout:5750 read 0x6bc9ef1 thru 0x6bd5c2e (0xbd3e bytes) 2024-09-14T07:12:54.987 INFO:teuthology.orchestra.run.smithi071.stdout:5752 read 0x11606b5 thru 0x1169ef9 (0x9845 bytes) 2024-09-14T07:12:54.987 INFO:teuthology.orchestra.run.smithi071.stdout:5753 read 0x5a5f4d3 thru 0x5a6abf0 (0xb71e bytes) 2024-09-14T07:12:54.996 INFO:teuthology.orchestra.run.smithi071.stdout:5754 write 0x9fc00a0 thru 0x9fcce5a (0xcdbb bytes) 2024-09-14T07:12:54.999 INFO:teuthology.orchestra.run.smithi071.stdout:5755 write 0x5f603a9 thru 0x5f6478e (0x43e6 bytes) 2024-09-14T07:12:55.001 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:55.000+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:55.001 INFO:teuthology.orchestra.run.smithi071.stdout:5759 writesame 0xfc3b06 thru 0xfccc08 data_size 0x1(0x9103 bytes) 2024-09-14T07:12:55.013 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.013 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.021 INFO:teuthology.orchestra.run.smithi071.stdout:5760 trunc from 0x9fcce5b to 0xb56cca0 2024-09-14T07:12:55.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:55.026 INFO:teuthology.orchestra.run.smithi071.stdout:5761 read 0x579cb43 thru 0x57a1eb8 (0x5376 bytes) 2024-09-14T07:12:55.027 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:55.027 INFO:teuthology.orchestra.run.smithi071.stdout:5763 read 0x90cac2c thru 0x90cdc2b (0x3000 bytes) 2024-09-14T07:12:55.027 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:55.027 INFO:teuthology.orchestra.run.smithi071.stdout:5766 read 0x2b1253a thru 0x2b1a9d8 (0x849f bytes) 2024-09-14T07:12:55.027 INFO:teuthology.orchestra.run.smithi071.stdout:5768 write 0x80228c thru 0x80bde4 (0x9b59 bytes) 2024-09-14T07:12:55.028 INFO:teuthology.orchestra.run.smithi071.stdout:5769 punch from 0x67bc305 to 0x67c7080, (0xad7b bytes) 2024-09-14T07:12:55.028 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:55.029 INFO:teuthology.orchestra.run.smithi071.stdout:5771 writesame 0x406af9c thru 0x40795a8 data_size 0x43(0xe60d bytes) 2024-09-14T07:12:55.030 INFO:teuthology.orchestra.run.smithi071.stdout:5773 write 0x7c204e9 thru 0x7c2c0cf (0xbbe7 bytes) 2024-09-14T07:12:55.033 INFO:teuthology.orchestra.run.smithi071.stdout:5775 read 0x24fff0 thru 0x25a321 (0xa332 bytes) 2024-09-14T07:12:55.035 INFO:teuthology.orchestra.run.smithi071.stdout:5777 trunc from 0xb56cca0 to 0xa2f6586 2024-09-14T07:12:55.041 INFO:teuthology.orchestra.run.smithi071.stdout:5778 write 0x9705675 thru 0x9710f2c (0xb8b8 bytes) 2024-09-14T07:12:55.044 INFO:teuthology.orchestra.run.smithi071.stdout:5779 write 0x6e35f0e thru 0x6e41b21 (0xbc14 bytes) 2024-09-14T07:12:55.056 INFO:teuthology.orchestra.run.smithi071.stdout:5780 writesame 0xd41737e thru 0xd4271c5 data_size 0x67(0xfe48 bytes) 2024-09-14T07:12:55.072 INFO:teuthology.orchestra.run.smithi071.stdout:5786 trunc from 0xd4271c6 to 0xe778ca 2024-09-14T07:12:55.097 INFO:teuthology.orchestra.run.smithi071.stdout:5787 read 0x6d03c3 thru 0x6d4d3c (0x497a bytes) 2024-09-14T07:12:55.098 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:55.098 INFO:teuthology.orchestra.run.smithi071.stdout:5790 clone 35 order 24 su 8388608 sc 5 2024-09-14T07:12:55.102 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:55.102+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:55.130 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.130 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:55.203 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:55.202+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:55.241 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.241 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:55.304 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:55.303+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:55.392 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.392 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:55.405 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:55.404+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:55.504 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.504 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.505 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:55.504+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:55.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:55.606 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:55.605+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:55.656 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.656 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:55.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:12:55.746 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:55.745+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:55.790 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-14T07:12:55.808 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:55.807+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:55.813 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.813 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:55.908 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:55.907+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:55.944 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:55.944 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:55.954 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:56.009 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:56.009+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:56.039 INFO:teuthology.orchestra.run.smithi071.stdout:5791 read 0x82809 thru 0x8b9cd (0x91c5 bytes) 2024-09-14T07:12:56.039 INFO:teuthology.orchestra.run.smithi071.stdout:5792 punch from 0x5267bf to 0x526dcc, (0x60d bytes) 2024-09-14T07:12:56.052 INFO:teuthology.orchestra.run.smithi071.stdout:5793 trunc from 0xe778ca to 0x8ba6c7c 2024-09-14T07:12:56.058 INFO:teuthology.orchestra.run.smithi071.stdout:5794 trunc from 0x8ba6c7c to 0x9193cbb 2024-09-14T07:12:56.062 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:56.062 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:56.064 INFO:teuthology.orchestra.run.smithi071.stdout:5796 read 0x4157838 thru 0x4163ae5 (0xc2ae bytes) 2024-09-14T07:12:56.064 INFO:teuthology.orchestra.run.smithi071.stdout:5799 writesame 0x243c99e thru 0x243e96d data_size 0x8(0x1fd0 bytes) 2024-09-14T07:12:56.067 INFO:teuthology.orchestra.run.smithi071.stdout:5800 punch from 0xa97d7 to 0xab2b9, (0x1ae2 bytes) 2024-09-14T07:12:56.067 INFO:teuthology.orchestra.run.smithi071.stdout:5801 writesame 0x5e1822b thru 0x5e1f625 data_size 0x3(0x73fb bytes) 2024-09-14T07:12:56.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:56.073 INFO:teuthology.orchestra.run.smithi071.stdout:5802 read 0x528a12e thru 0x5290fa8 (0x6e7b bytes) 2024-09-14T07:12:56.073 INFO:teuthology.orchestra.run.smithi071.stdout:5803 clone 36 order 25 su 131072 sc 15 2024-09-14T07:12:56.117 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:56.116+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:56.175 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:56.175 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:56.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:56.225 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:56.224+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:56.311 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:56.311+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:56.326 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:56.327 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:56.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:56.413 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:56.412+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:56.477 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:56.477 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:56.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:56.529 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:56.528+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:56.588 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:56.588 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:56.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:12:56.614 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:56.614+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:56.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:12:56.705 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:12:56.715 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:56.714+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:56.749 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:56.749 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:56.761 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:12:56.765 INFO:teuthology.orchestra.run.smithi071.stdout:flattening image image_client.0-clone35 2024-09-14T07:12:56.773 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:56.773 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:56.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:56.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:56.804 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-14T07:12:56.804 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-09-14T07:12:56.804 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T07:12:56.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T07:12:56.807 INFO:tasks.ceph.osd.5:Started 2024-09-14T07:12:56.807 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:12:56.808 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:56.809 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:56.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:56.844 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:56.844 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:56.844 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:56.851 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:56.850+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:56.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:56.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:56.879 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:56.879 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:56.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:56.884 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:56.884 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:56.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:12:56.890 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:no valid command found; 10 closest matches: 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:0 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:1 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:2 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:abort 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:assert 2024-09-14T07:12:56.908 INFO:teuthology.orchestra.run.smithi086.stderr:config diff 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:config diff get 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:config get 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:config help [] 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:config set ... 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi086.stderr:admin_socket: invalid command 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:56.909 INFO:teuthology.orchestra.run.smithi071.stdout:5805 trunc from 0x9193cbb to 0x85e208b 2024-09-14T07:12:56.910 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T07:12:56.911 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-14T07:12:56.917 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:56.916+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:56.961 INFO:teuthology.orchestra.run.smithi071.stdout:5807 punch from 0x55a2221 to 0x55aab38, (0x8917 bytes) 2024-09-14T07:12:56.961 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:56.965 INFO:teuthology.orchestra.run.smithi071.stdout:5809 trunc from 0x85e208b to 0x4b7bea4 2024-09-14T07:12:56.980 INFO:teuthology.orchestra.run.smithi071.stdout:5811 write 0x74b1e37 thru 0x74ba91a (0x8ae4 bytes) 2024-09-14T07:12:56.982 INFO:teuthology.orchestra.run.smithi071.stdout:5813 read 0xa01e32 thru 0xa06964 (0x4b33 bytes) 2024-09-14T07:12:56.982 INFO:teuthology.orchestra.run.smithi071.stdout:5816 writesame 0x3b5398b thru 0x3b594ad data_size 0x21(0x5b23 bytes) 2024-09-14T07:12:56.984 INFO:teuthology.orchestra.run.smithi071.stdout:5817 read 0x3222cde thru 0x3228cb3 (0x5fd6 bytes) 2024-09-14T07:12:56.991 INFO:teuthology.orchestra.run.smithi071.stdout:5818 writesame 0x90be859 thru 0x90ce7fc data_size 0x2(0xffa4 bytes) 2024-09-14T07:12:56.992 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:56.992 INFO:teuthology.orchestra.run.smithi071.stdout:5820 write 0x3185027 thru 0x318a358 (0x5332 bytes) 2024-09-14T07:12:57.001 INFO:teuthology.orchestra.run.smithi071.stdout:5825 writesame 0xae8f3d9 thru 0xae9c127 data_size 0xd(0xcd4f bytes) 2024-09-14T07:12:57.002 INFO:teuthology.orchestra.run.smithi071.stdout:5827 read 0x93a4b1a thru 0x93ad0d9 (0x85c0 bytes) 2024-09-14T07:12:57.003 INFO:teuthology.orchestra.run.smithi071.stdout:5828 read 0x84a2f6a thru 0x84a490d (0x19a4 bytes) 2024-09-14T07:12:57.003 INFO:teuthology.orchestra.run.smithi071.stdout:5829 punch from 0x3690f92 to 0x3693b9b, (0x2c09 bytes) 2024-09-14T07:12:57.003 INFO:teuthology.orchestra.run.smithi071.stdout:5830 read 0x3d02c74 thru 0x3d0874e (0x5adb bytes) 2024-09-14T07:12:57.003 INFO:teuthology.orchestra.run.smithi071.stdout:5831 write 0x63b6f51 thru 0x63c38f1 (0xc9a1 bytes) 2024-09-14T07:12:57.004 INFO:teuthology.orchestra.run.smithi071.stdout:5832 read 0x39f22a2 thru 0x39f313f (0xe9e bytes) 2024-09-14T07:12:57.005 INFO:teuthology.orchestra.run.smithi071.stdout:5837 write 0xa5cd91f thru 0xa5dd49c (0xfb7e bytes) 2024-09-14T07:12:57.006 INFO:teuthology.orchestra.run.smithi071.stdout:5838 write 0x10b2dd7 thru 0x10baea2 (0x80cc bytes) 2024-09-14T07:12:57.007 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:57.007 INFO:teuthology.orchestra.run.smithi071.stdout:5843 write 0x660285 thru 0x667485 (0x7201 bytes) 2024-09-14T07:12:57.008 INFO:teuthology.orchestra.run.smithi071.stdout:5844 read 0x301dbb3 thru 0x30282bf (0xa70d bytes) 2024-09-14T07:12:57.011 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:57.011 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.243396171999997, 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:12:57.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:12:57.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:12:57.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:12:57.016 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.242297282999999, 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:12:57.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:12:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:12:57.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:12:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:57.024 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.215454123999997, 2024-09-14T07:12:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:12:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:12:57.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:12:57.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.031 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.202160118999998, 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:57.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:12:57.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:12:57.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:12:57.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:12:57.037 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.202090705000003, 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:12:57.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:12:57.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.361712679999997, 2024-09-14T07:12:57.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:12:57.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:12:57.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.052 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:12:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.186121442000001, 2024-09-14T07:12:57.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:12:57.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:12:57.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.061 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.896056545999997, 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:12:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:12:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:12:57.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.892028248000003, 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.068 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.671029124999997, 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:12:57.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.667511314000002, 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:12:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:12:57.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:12:57.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:71337 3.9 e64/23 3:9465e89a:::rbd_data.118266971d4e.0000000000000124:head v 64'216, mlcod=63'214)", 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.666132601000001, 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003270069, 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:57.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344128+0000", 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8999999999999995e-07 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344145+0000", 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7317999999999999e-05 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344156+0000", 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1374e-05 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344163+0000", 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3169999999999998e-06 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344209+0000", 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6301999999999998e-05 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344224+0000", 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5418999999999999e-05 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347364+0000", 2024-09-14T07:12:57.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031395490000000002 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347397+0000", 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.29e-05 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.197372334000001, 2024-09-14T07:12:57.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:12:57.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:12:57.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:12:57.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.545008994, 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:12:57.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.097 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2065105529999993, 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:12:57.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:12:57.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2008626499999995, 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:12:57.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4633759670000002, 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:12:57.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:12:57.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:12:57.111 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2354900659999997, 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:12:57.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.115 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9827932920000002, 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:12:57.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.940845682, 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:12:57.120 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:12:57.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:12:57.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.125 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.125 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:57.126 INFO:teuthology.orchestra.run.smithi071.stdout:5845 write 0xb1f154f thru 0xb1fac19 (0x96cb bytes) 2024-09-14T07:12:57.126 INFO:teuthology.orchestra.run.smithi071.stdout:5846 read 0x7cbf58a thru 0x7cc4398 (0x4e0f bytes) 2024-09-14T07:12:57.126 INFO:teuthology.orchestra.run.smithi071.stdout:5847 read 0xa8aa7f9 thru 0xa8b9e8d (0xf695 bytes) 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:5849 read 0xa68ecb8 thru 0xa698f35 (0xa27e bytes) 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:5853 read 0x9d711a9 thru 0x9d71210 (0x68 bytes) 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:5854 write 0x9d3eebc thru 0x9d48ce7 (0x9e2c bytes) 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:5856 punch from 0x40942a6 to 0x409e407, (0xa161 bytes) 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:5860 read 0x32e3ebf thru 0x32eff8f (0xc0d1 bytes) 2024-09-14T07:12:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:5861 trunc from 0xb1fac1a to 0xacbe9f1 2024-09-14T07:12:57.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5862 write 0xe4c45ee thru 0xe4cbfe8 (0x79fb bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5863 flatten 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5864 read 0x39b6134 thru 0x39c5c42 (0xfb0f bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5866 write 0xbdc1046 thru 0xbdc6b2b (0x5ae6 bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5867 write 0x9824329 thru 0x983335b (0xf033 bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5868 read 0x5d9d418 thru 0x5daa928 (0xd511 bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5869 write 0xdef8f7 thru 0xdf24bf (0x2bc9 bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5870 read 0xdc41bdd thru 0xdc45203 (0x3627 bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5871 trunc from 0xe4cbfe9 to 0x9c39c37 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5872 read 0x8ce8d24 thru 0x8cea98d (0x1c6a bytes) 2024-09-14T07:12:57.130 INFO:teuthology.orchestra.run.smithi071.stdout:5873 punch from 0x8c7e890 to 0x8c8c3aa, (0xdb1a bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5874 write 0xc92785e thru 0xc93706f (0xf812 bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5875 writesame 0x176a43d thru 0x176d379 data_size 0x3(0x2f3d bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5876 write 0x64361da thru 0x6439fc0 (0x3de7 bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5877 punch from 0xc35e917 to 0xc35f618, (0xd01 bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5879 read 0x69f54d5 thru 0x69f6136 (0xc62 bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5880 write 0xcddcaaa thru 0xcde17d7 (0x4d2e bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5882 writesame 0xd278c0 thru 0xd2f7e8 data_size 0x3(0x7f29 bytes) 2024-09-14T07:12:57.131 INFO:teuthology.orchestra.run.smithi071.stdout:5886 clone 37 order 20 su 65536 sc 2 2024-09-14T07:12:57.131 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:57.125+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:57.226 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:57.226+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:57.271 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:57.271 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:57.271 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:12:57.271 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:57.279 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:12:57.364 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:57.363+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:57.423 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:57.423 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:12:57.423 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:12:57.423 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:12:57.424 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:57.429 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:57.428+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:57.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:12:57.529 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:57.529+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:57.576 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:12:57.576 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:12:57.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:12:57.576 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.606041836999999, 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:12:57.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:12:57.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.606009485000001, 2024-09-14T07:12:57.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:57.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605924834, 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:12:57.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605899475000001, 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:12:57.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605866767000002, 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:12:57.595 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:12:57.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605834643000001, 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:12:57.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605803225000002, 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:12:57.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.609 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605779255999998, 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:12:57.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605759558000003, 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:12:57.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605745616, 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.619 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:12:57.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605734386000002, 2024-09-14T07:12:57.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:57.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:12:57.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605723257999998, 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.628 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:12:57.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605712095999998, 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.633 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605701385000003, 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.638 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:12:57.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605691677999999, 2024-09-14T07:12:57.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:57.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:12:57.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605682113999997, 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.647 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:12:57.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605672777999999, 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:12:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:12:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:12:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:57.656 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605662586000001, 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:57.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:12:57.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605642209000003, 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.661 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.605596165000001, 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:57.666 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:12:57.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:12:57.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:12:57.670 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:12:57.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:12:57.672 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:57.671+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:57.728 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:12:57.727+0000 7f349f20c640 -1 Falling back to public interface 2024-09-14T07:12:57.772 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:57.771+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:57.783 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:57.783 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:57.783 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:57.783 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:57.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:12:57.873 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:12:57.872+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:12:57.889 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-14T07:12:57.896 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:57.896 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:57.896 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:57.896 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:57.896 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:57.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:12:57.974 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:57.973+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:58.009 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:58.009 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:58.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.662644216, 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.010 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:12:58.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:58.014 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.662633766999999, 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:58.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:12:58.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:12:58.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.662623814, 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.019 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:12:58.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:58.023 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.66261289, 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:12:58.027 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.662602647, 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.028 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656657081000001, 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:12:58.033 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:12:58.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:12:58.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.037 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656635946, 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:12:58.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:12:58.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:12:58.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656614451999999, 2024-09-14T07:12:58.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:12:58.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656591424, 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:12:58.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656570049000001, 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:12:58.051 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:12:58.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:12:58.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656558630999999, 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.056 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:12:58.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656544029999999, 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.060 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:12:58.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:12:58.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656532962, 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.065 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.069 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656522102, 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:12:58.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656510083000001, 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:12:58.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:12:58.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.65650026, 2024-09-14T07:12:58.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:12:58.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.084 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656485532, 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:12:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.656475404, 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.089 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.65646585, 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:12:58.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:12:58.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.002696373999999, 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:58.098 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:12:58.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:58.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.104 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:58.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:12:58.106 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:58.104+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:5887 writesame 0x99c562b thru 0x99c8af7 data_size 0x1(0x34cd bytes) 2024-09-14T07:12:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:5888 punch from 0x8579886 to 0x85885ac, (0xed26 bytes) 2024-09-14T07:12:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:5889 write 0xba4d248 thru 0xba5d1a0 (0xff59 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5892 read 0x8f5c336 thru 0x8f5fd25 (0x39f0 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5893 write 0xd013c00 thru 0xd02084d (0xcc4e bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5894 writesame 0xa9e4b49 thru 0xa9ef058 data_size 0x4c(0xa510 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5895 writesame 0xaa4351e thru 0xaa497ad data_size 0x13(0x6290 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5896 write 0xa4411bc thru 0xa44caa6 (0xb8eb bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5899 writesame 0x95e623f thru 0x95f199e data_size 0x18(0xb760 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5900 writesame 0x5c4c456 thru 0x5c4eabc data_size 0x1d(0x2667 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5901 read 0x393ab73 thru 0x3940179 (0x5607 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5905 read 0xa5e755d thru 0xa5e917d (0x1c21 bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5906 read 0x5791f4 thru 0x57a8af (0x16bc bytes) 2024-09-14T07:12:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:5907 write 0xb9cefe1 thru 0xb9d3d8e (0x4dae bytes) 2024-09-14T07:12:58.113 INFO:teuthology.orchestra.run.smithi071.stdout:5908 read 0x16ec120 thru 0x16f2ee8 (0x6dc9 bytes) 2024-09-14T07:12:58.114 INFO:teuthology.orchestra.run.smithi071.stdout:5910 write 0x6ed53fd thru 0x6ed9f5d (0x4b61 bytes) 2024-09-14T07:12:58.128 INFO:teuthology.orchestra.run.smithi071.stdout:5912 trunc from 0xd02084e to 0x3c13b3a 2024-09-14T07:12:58.151 INFO:teuthology.orchestra.run.smithi071.stdout:5913 writesame 0x1f57fb0 thru 0x1f5eff6 data_size 0x43(0x7047 bytes) 2024-09-14T07:12:58.154 INFO:teuthology.orchestra.run.smithi071.stdout:5914 read 0x28f69d7 thru 0x28fa402 (0x3a2c bytes) 2024-09-14T07:12:58.155 INFO:teuthology.orchestra.run.smithi071.stdout:5916 read 0x9759d0 thru 0x982fa8 (0xd5d9 bytes) 2024-09-14T07:12:58.155 INFO:teuthology.orchestra.run.smithi071.stdout:5917 punch from 0x14e39a9 to 0x14e487b, (0xed2 bytes) 2024-09-14T07:12:58.156 INFO:teuthology.orchestra.run.smithi071.stdout:5918 read 0x2c2d496 thru 0x2c3993a (0xc4a5 bytes) 2024-09-14T07:12:58.156 INFO:teuthology.orchestra.run.smithi071.stdout:5919 read 0x3c002de thru 0x3c07c0e (0x7931 bytes) 2024-09-14T07:12:58.156 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.156 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.173 INFO:teuthology.orchestra.run.smithi071.stdout:5923 write 0xdb3cccc thru 0xdb40f39 (0x426e bytes) 2024-09-14T07:12:58.178 INFO:teuthology.orchestra.run.smithi071.stdout:5924 read 0xc79c7b6 thru 0xc7a39f8 (0x7243 bytes) 2024-09-14T07:12:58.178 INFO:teuthology.orchestra.run.smithi071.stdout:5925 read 0x369d03b thru 0x36a01d3 (0x3199 bytes) 2024-09-14T07:12:58.179 INFO:teuthology.orchestra.run.smithi071.stdout:5926 write 0xa49aa03 thru 0xa4a50b6 (0xa6b4 bytes) 2024-09-14T07:12:58.185 INFO:teuthology.orchestra.run.smithi071.stdout:5929 write 0xb8810e7 thru 0xb8842db (0x31f5 bytes) 2024-09-14T07:12:58.188 INFO:teuthology.orchestra.run.smithi071.stdout:5930 read 0x4fb7833 thru 0x4fc3a8f (0xc25d bytes) 2024-09-14T07:12:58.188 INFO:teuthology.orchestra.run.smithi071.stdout:5933 punch from 0x4fde88a to 0x4fe557e, (0x6cf4 bytes) 2024-09-14T07:12:58.189 INFO:teuthology.orchestra.run.smithi071.stdout:5936 writesame 0x293af3 thru 0x2a0892 data_size 0x70(0xcda0 bytes) 2024-09-14T07:12:58.196 INFO:teuthology.orchestra.run.smithi071.stdout:5937 write 0x38af20 thru 0x3957bf (0xa8a0 bytes) 2024-09-14T07:12:58.198 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.198 INFO:teuthology.orchestra.run.smithi071.stdout:5939 read 0xa9888c2 thru 0xa994405 (0xbb44 bytes) 2024-09-14T07:12:58.205 INFO:teuthology.orchestra.run.smithi071.stdout:5942 trunc from 0xdb40f3a to 0x7a161d6 2024-09-14T07:12:58.206 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:58.205+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:58.215 INFO:teuthology.orchestra.run.smithi071.stdout:5944 write 0x169e713 thru 0x16ac992 (0xe280 bytes) 2024-09-14T07:12:58.220 INFO:teuthology.orchestra.run.smithi071.stdout:5946 punch from 0x53a1c55 to 0x53ab7db, (0x9b86 bytes) 2024-09-14T07:12:58.228 INFO:teuthology.orchestra.run.smithi071.stdout:5947 trunc from 0x7a161d6 to 0xe6e1a1c 2024-09-14T07:12:58.233 INFO:teuthology.orchestra.run.smithi071.stdout:5948 write 0x8434b7b thru 0x8439abe (0x4f44 bytes) 2024-09-14T07:12:58.236 INFO:teuthology.orchestra.run.smithi071.stdout:5951 write 0x60c944c thru 0x60d2c23 (0x97d8 bytes) 2024-09-14T07:12:58.240 INFO:teuthology.orchestra.run.smithi071.stdout:5953 punch from 0x360ac01 to 0x36151f4, (0xa5f3 bytes) 2024-09-14T07:12:58.240 INFO:teuthology.orchestra.run.smithi071.stdout:5956 writesame 0x4879372 thru 0x487b5e3 data_size 0x2(0x2272 bytes) 2024-09-14T07:12:58.243 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.243 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.254 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:58.254 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:58.254 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:58.254 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:58.256 INFO:teuthology.orchestra.run.smithi071.stdout:5960 trunc from 0xe6e1a1c to 0x356c923 2024-09-14T07:12:58.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:12:58.281 INFO:teuthology.orchestra.run.smithi071.stdout:5961 write 0x757dd73 thru 0x758dbb0 (0xfe3e bytes) 2024-09-14T07:12:58.289 INFO:teuthology.orchestra.run.smithi071.stdout:5962 read 0x2824c7d thru 0x28342db (0xf65f bytes) 2024-09-14T07:12:58.289 INFO:teuthology.orchestra.run.smithi071.stdout:5963 write 0x72c7869 thru 0x72cdd06 (0x649e bytes) 2024-09-14T07:12:58.290 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.292 INFO:teuthology.orchestra.run.smithi071.stdout:5965 trunc from 0x758dbb1 to 0x8b8b1f0 2024-09-14T07:12:58.297 INFO:teuthology.orchestra.run.smithi071.stdout:5966 read 0x53865cc thru 0x538aa7c (0x44b1 bytes) 2024-09-14T07:12:58.297 INFO:teuthology.orchestra.run.smithi071.stdout:5968 writesame 0x7b92287 thru 0x7b94be2 data_size 0x2(0x295c bytes) 2024-09-14T07:12:58.302 INFO:teuthology.orchestra.run.smithi071.stdout:5970 writesame 0x4ef4050 thru 0x4efaee3 data_size 0x2a(0x6e94 bytes) 2024-09-14T07:12:58.307 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:58.306+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:58.307 INFO:teuthology.orchestra.run.smithi071.stdout:5971 writesame 0x698a4e8 thru 0x69917ee data_size 0x1(0x7307 bytes) 2024-09-14T07:12:58.322 INFO:teuthology.orchestra.run.smithi071.stdout:5972 read 0x2b69dcd thru 0x2b7399c (0x9bd0 bytes) 2024-09-14T07:12:58.330 INFO:teuthology.orchestra.run.smithi071.stdout:5974 writesame 0xb5fa0d9 thru 0xb5fd2da data_size 0x25(0x3202 bytes) 2024-09-14T07:12:58.330 INFO:teuthology.orchestra.run.smithi071.stdout:5975 writesame 0x78a0e5 thru 0x79092c data_size 0x8(0x6848 bytes) 2024-09-14T07:12:58.341 INFO:teuthology.orchestra.run.smithi071.stdout:5976 read 0x567403b thru 0x567f8c7 (0xb88d bytes) 2024-09-14T07:12:58.341 INFO:teuthology.orchestra.run.smithi071.stdout:5978 read 0x4ff6e0d thru 0x4ffeb60 (0x7d54 bytes) 2024-09-14T07:12:58.341 INFO:teuthology.orchestra.run.smithi071.stdout:5979 writesame 0x8865303 thru 0x886bd9d data_size 0xb(0x6a9b bytes) 2024-09-14T07:12:58.347 INFO:teuthology.orchestra.run.smithi071.stdout:5981 punch from 0x5099fe6 to 0x50a6149, (0xc163 bytes) 2024-09-14T07:12:58.347 INFO:teuthology.orchestra.run.smithi071.stdout:5982 punch from 0x5ec927 to 0x5fa810, (0xdee9 bytes) 2024-09-14T07:12:58.347 INFO:teuthology.orchestra.run.smithi071.stdout:5983 read 0x8d2928f thru 0x8d3500e (0xbd80 bytes) 2024-09-14T07:12:58.347 INFO:teuthology.orchestra.run.smithi071.stdout:5985 write 0x8e50505 thru 0x8e59d5d (0x9859 bytes) 2024-09-14T07:12:58.351 INFO:teuthology.orchestra.run.smithi071.stdout:5986 punch from 0x6d59d07 to 0x6d5cc09, (0x2f02 bytes) 2024-09-14T07:12:58.351 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.351 INFO:teuthology.orchestra.run.smithi071.stdout:5989 write 0x32fd0a2 thru 0x330a4fd (0xd45c bytes) 2024-09-14T07:12:58.361 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.361 INFO:teuthology.orchestra.run.smithi071.stdout:5991 write 0x488c978 thru 0x489287c (0x5f05 bytes) 2024-09-14T07:12:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:5992 punch from 0x3164735 to 0x316d548, (0x8e13 bytes) 2024-09-14T07:12:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.375 INFO:teuthology.orchestra.run.smithi071.stdout:5994 write 0xde5d1d1 thru 0xde69b2e (0xc95e bytes) 2024-09-14T07:12:58.380 INFO:teuthology.orchestra.run.smithi071.stdout:5995 write 0x67b2706 thru 0x67b761a (0x4f15 bytes) 2024-09-14T07:12:58.383 INFO:teuthology.orchestra.run.smithi071.stdout:5996 read 0xabe2717 thru 0xabecccf (0xa5b9 bytes) 2024-09-14T07:12:58.383 INFO:teuthology.orchestra.run.smithi071.stdout:5997 write 0xbca6113 thru 0xbcacb93 (0x6a81 bytes) 2024-09-14T07:12:58.386 INFO:teuthology.orchestra.run.smithi071.stdout:5998 write 0x874028f thru 0x874d817 (0xd589 bytes) 2024-09-14T07:12:58.388 INFO:teuthology.orchestra.run.smithi071.stdout:5999 read 0xb2ed3d thru 0xb3d880 (0xeb44 bytes) 2024-09-14T07:12:58.389 INFO:teuthology.orchestra.run.smithi071.stdout:compare and write disabled 2024-09-14T07:12:58.401 INFO:teuthology.orchestra.run.smithi071.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-14T07:12:58.408 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:58.407+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:58.413 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:58.413 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:58.413 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:58.413 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:58.413 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:58.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:12:58.509 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:58.508+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.708589187999998, 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.567 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:12:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:12:58.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752119016999998, 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:12:58.574 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:12:58.578 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752108697000001, 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.579 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:12:58.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.583 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752089721000001, 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:12:58.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:12:58.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752078296000001, 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.588 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752066800000001, 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:12:58.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752055751, 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.597 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:12:58.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.601 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752045436, 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:12:58.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.752006182999999, 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:12:58.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.746111233000001, 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:12:58.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:12:58.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.615 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.746100467000002, 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:12:58.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.746090207999998, 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.620 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:12:58.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.624 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.746079502000001, 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:12:58.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:12:58.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.746065734999998, 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:12:58.629 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:12:58.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.746055264999999, 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.634 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:12:58.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.635 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:12:58.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.639 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.740100106, 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:12:58.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:12:58.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.740089734000001, 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:12:58.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.649 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.740078807, 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:12:58.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.740069252000001, 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:58.654 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.422116559999999, 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:58.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:12:58.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:58.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:12:58.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:58.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:58.665 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:58.667 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:12:58.667 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:58.665+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:58.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:12:58.767 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:12:58.766+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:12:58.776 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:58.776 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:58.776 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:12:58.776 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:58.785 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:12:58.868 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:58.867+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:58.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:12:58.928 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:58.928 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:12:58.928 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:12:58.928 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:12:58.928 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:58.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:12:58.970 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:12:58.969+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:12:59.005 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:12:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:12:59.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:12:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:12:59.038 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:12:59.038 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:59.041 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 80.904824912999999, 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:12:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:12:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:59.049 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.349508391000001, 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:12:59.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:12:59.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:12:59.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:59.056 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129235494, 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:12:59.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:12:59.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:12:59.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:12:59.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:12:59.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:12:59.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129213802999999, 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:12:59.063 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:12:59.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129193899999997, 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:59.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:12:59.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129172406000002, 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:12:59.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:12:59.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:12:59.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:12:59.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:12:59.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:12:59.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:12:59.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:12:59.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:12:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.080 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129154085000003, 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.081 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:59.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:12:59.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:12:59.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129127742000001, 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:12:59.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:12:59.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:12:59.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:12:59.091 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.091 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.092 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.092 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.092 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:59.093 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129107277000003, 2024-09-14T07:12:59.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:12:59.093 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.093 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.093 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.093 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:59.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:59.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:12:59.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:12:59.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:12:59.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:12:59.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:12:59.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:12:59.101 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.101 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.101 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.102 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.102 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:59.102 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129085422000003, 2024-09-14T07:12:59.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:12:59.103 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.103 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.103 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.103 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:59.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:59.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:12:59.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:12:59.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:12:59.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129066786999999, 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.114 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:59.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:12:59.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129040646, 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:12:59.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:12:59.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:12:59.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.129013127999997, 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.124 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:12:59.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.128995648999997, 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:12:59.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.133 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.128983533000003, 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.134 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:12:59.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.123541514999999, 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:12:59.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:12:59.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.123522190999999, 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.144 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:59.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.123493341, 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.123452817, 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:12:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:12:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.123430792000001, 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:12:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:12:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:12:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:12:59.163 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:12:59.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:12:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:12:59.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:12:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:12:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:12:59.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:12:59.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:12:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:12:59.167 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:12:59.168 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:12:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:12:59.169 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:12:59.169 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:59.164+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:59.265 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:59.264+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:59.313 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:59.313 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:59.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:12:59.366 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:12:59.365+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:12:59.465 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:59.465 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:59.467 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:59.466+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:59.473 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:12:59.568 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:59.567+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:59.577 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:59.577 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:59.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:12:59.669 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:59.668+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:59.689 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:59.689 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:59.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:12:59.716 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:12:59.777 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:12:59.776+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:12:59.831 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:59.831 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:59.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:12:59.870 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:12:59.870+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:12:59.971 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:12:59.971+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:12:59.983 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:12:59.983 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:12:59.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:00.073 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:00.072+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:00.137 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.137 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:00.189 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:00.188+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:00.248 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.248 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:00.298 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:00.297+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:00.376 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:00.375+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:00.399 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.399 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:00.477 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:00.476+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:00.511 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.511 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.519 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:00.578 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:00.577+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:00.661 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.661 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:00.714 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:00.713+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:00.780 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:00.779+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:00.781 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.781 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:00.881 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:00.880+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:00.901 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:00.901 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:00.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:00.982 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:00.981+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:01.013 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:01.013 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:01.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:01.083 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:01.082+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:01.123 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:01.123 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:01.132 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:01.170 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:01.215 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:01.214+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:01.282 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:01.282 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:01.284 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:01.284+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:01.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:01.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:01.304 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:01.320 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:01.320 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:01.336 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:01.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:01.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:01.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:01.369 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:01.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:01.370 INFO:teuthology.orchestra.run.smithi071.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-14T07:13:01.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:01.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:01.386 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:01.385+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:01.395 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:01.395 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:01.395 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:01.395 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:01.395 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:01.402 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:01.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:01.406 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T07:13:01.406 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T07:13:01.488 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:01.487+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:01.541 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:01.540+0000 7f349f20c640 -1 osd.5 32 log_to_monitors true 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.692639298000003, 2024-09-14T07:13:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736169127, 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736158806999999, 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736139830999999, 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736128405999999, 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.73611691, 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736105860999999, 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736095546000001, 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.736056293000001, 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.730161342999999, 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.730150577, 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.730140318, 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.730129611999999, 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.730115845, 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.730105375000001, 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.724150215999998, 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.724139844, 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.724128917000002, 2024-09-14T07:13:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 25.724119362, 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.406166670000001, 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:01.646 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:01.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:01.647 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:01.646+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:01.736 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:13:01.777 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:01.776+0000 7f34929e7640 -1 osd.5 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T07:13:01.780 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:01.779+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:01.799 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:01.799 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:01.799 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:01.799 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:01.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:01.848 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:01.847+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:01.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:01.913 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:01.914 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:01.914 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:01.914 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:01.914 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:01.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:01.949 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:01.948+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:02.016 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:02.016 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:02.016 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:02.016 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:02.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.931586179999996, 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:02.068 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:02.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:02.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:02.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:02.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:02.075 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.376269657999998, 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:02.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:02.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:02.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:02.081 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155996760999997, 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:02.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.085 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155975069999997, 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.086 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:02.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155955167000002, 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:02.090 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155933673, 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.095 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:02.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.099 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155915352000001, 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:02.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155889008999999, 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.104 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:02.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.108 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155868544, 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:02.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155846689000001, 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.113 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.117 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155828053999997, 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:02.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:02.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155801912999998, 2024-09-14T07:13:02.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155774395000002, 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.127 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:02.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155756916000001, 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:02.131 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:02.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:02.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.155744800000001, 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.136 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:02.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.150302781999997, 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.140 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:02.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:02.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.144 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.150283457999997, 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:02.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.150254607999997, 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:02.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.150214083999998, 2024-09-14T07:13:02.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:02.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.150192058999998, 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:02.159 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:02.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:02.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:02.164 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:02.165 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:02.068+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:02.166 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:02.166 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:02.165+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:02.266 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:02.266+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:02.309 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:02.309 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:02.309 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:02.309 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:02.318 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:02.402 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:02.401+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:02.461 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:02.461 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:02.461 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:02.461 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:02.461 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:02.468 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:02.467+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:02.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:02.569 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:02.569+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:02.612 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:02.612 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:02.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:02.612 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [] 2024-09-14T07:13:02.612 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:02.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:02.670 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:02.669+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:02.725 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:02.725 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:02.725 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:02.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:13:02.743 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T07:13:02.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T07:13:02.771 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:02.771+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:02.853 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:02.853 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:02.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:02.907 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:02.906+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:02.969 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.111679391000003, 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:02.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:02.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:13:02.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:13:02.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.111643778999998, 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:13:02.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:02.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.983 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.108603176999999, 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.984 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:13:02.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:13:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:02.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623904225, 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:02.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:02.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:02.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:13:02.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:13:02.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623885494, 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:02.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:02.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:13:03.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:13:03.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623849865, 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:03.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.007 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623816404999999, 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:13:03.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623791410999999, 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:13:03.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623738210999999, 2024-09-14T07:13:03.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:03.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:13:03.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623717257999999, 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:13:03.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:13:03.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.623681197, 2024-09-14T07:13:03.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:13:03.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:13:03.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.622130877, 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:13:03.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:13:03.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.622115979, 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:13:03.035 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:13:03.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.622104364999998, 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:13:03.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.622081388000002, 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.044 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.622041439, 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:03.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:13:03.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.622019774999998, 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:13:03.053 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:13:03.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.621971662, 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.058 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:13:03.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.621958466999999, 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:13:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:13:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.621946855000001, 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.071 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:03.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:03.073 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:03.072+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:03.173 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:03.173+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:03.217 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:03.217 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:03.217 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:03.217 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:03.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:03.311 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:03.310+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:03.370 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:03.370 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:03.370 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:03.371 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:03.371 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:03.376 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:03.375+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:03.379 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:03.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:03.477 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:03.477+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:03.527 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490841947, 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:13:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490816475000003, 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490804802, 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:13:03.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490794027, 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:13:03.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:03.546 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490783485999998, 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:03.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.550 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490773017999999, 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.551 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:13:03.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:03.555 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490762506000003, 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:13:03.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490752168, 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:03.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.564 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490741825000001, 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:13:03.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490723236999997, 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.570 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:03.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.574 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490712146999996, 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:13:03.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490701444999999, 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.579 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:13:03.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490680695999998, 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.584 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:13:03.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490654835000001, 2024-09-14T07:13:03.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:13:03.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490634999000001, 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.593 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:13:03.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:13:03.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490609376000002, 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:13:03.597 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490570566999999, 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:13:03.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:13:03.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:13:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:13:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.490549897999998, 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:13:03.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.485188968000003, 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:13:03.615 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:13:03.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:13:03.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.485174413999999, 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:13:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:03.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:03.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:03.624 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:03.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:03.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:03.626 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:03.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:03.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:03.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:03.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:03.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-14T07:13:03.629 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:03.624+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:03.641 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:03.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:03.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:03.726 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:03.726+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T07:13:03.745 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:03.745 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:03.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:03.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T07:13:03.847 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:03.846+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:03.864 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:03.864 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:03.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:03.960 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:03.959+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:04.019 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.020 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:04.070 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:04.069+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:04.132 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:04.131+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:04.172 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.172 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:04.233 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:04.232+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:04.283 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.283 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:04.337 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:04.336+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:04.396 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.396 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:04.446 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:04.445+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:04.521 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.521 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.530 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:04.535 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:04.534+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:04.633 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.634 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.635 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:04.634+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:04.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:04.736 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:04.735+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:04.746 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.746 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.751 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T07:13:04.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:04.764 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:13:04.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T07:13:04.851 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:04.850+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:04.921 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:04.921 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:04.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:04.938 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:04.937+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:05.041 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:05.041+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:05.047 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.047 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:05.142 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:05.141+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:05.211 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.211 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:05.245 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:05.245+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:05.333 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.333 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:05.346 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:05.345+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:05.447 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:05.446+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:05.453 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.453 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:05.548 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:05.547+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:05.568 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.568 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:05.648 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:05.648+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:05.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:05.720 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.720 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:05.750 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:05.749+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:05.762 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T07:13:05.769 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:13:05.785 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T07:13:05.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:05.800 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:05.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:05.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:05.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:05.834 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:05.834 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:05.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:05.849 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:05.850 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:05.866 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:05.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:05.883 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:05.883 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:05.885 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:05.885+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:05.900 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:05.901 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:05.919 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:05.919 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:05.948 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:05.948 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [] 2024-09-14T07:13:05.948 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:05.950 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:05.950+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:05.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:06.052 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:06.051+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:06.074 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:06.075 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:06.075 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:06.075 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:06.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:06.152 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:06.151+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:06.186 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:06.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:06.186 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:06.186 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:06.187 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:06.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:06.279 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:06.278+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:06.338 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:06.338 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.480564968000003, 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:06.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:13:06.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:13:06.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.480529355999998, 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:13:06.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:13:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.477488753999999, 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:13:06.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:13:06.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:13:06.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992789802000001, 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.360 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:13:06.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992771071, 2024-09-14T07:13:06.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:06.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:13:06.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992735442000001, 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992701982, 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:13:06.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:13:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.378 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992676987999999, 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:13:06.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992623788, 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.383 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:13:06.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992602835, 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.388 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:13:06.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.992566774, 2024-09-14T07:13:06.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:13:06.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.991016454, 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:13:06.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.991001556000001, 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:13:06.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990989941999999, 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.406 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:13:06.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990966964999998, 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:06.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990927016000001, 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.415 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:13:06.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:13:06.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990905351999999, 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:13:06.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:13:06.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990857239, 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:13:06.424 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:13:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990844043999999, 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:13:06.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:06.433 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.990832432000001, 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:06.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.438 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.438 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:06.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:06.440 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:06.438+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:06.539 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:06.539+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:06.584 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:06.584 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:06.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:06.678 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:06.677+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:06.736 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:06.736 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:06.741 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:06.741+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:06.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T07:13:06.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T07:13:06.843 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:06.842+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:06.882 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845867800999997, 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.887 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845842329, 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:13:06.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:13:06.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845830655999997, 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:06.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.896 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845819880999997, 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:13:06.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845809340000002, 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:06.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.905 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845798872000003, 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.84578836, 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845778021999998, 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:13:06.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845767678999998, 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:13:06.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:13:06.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845749091000002, 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:13:06.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:06.927 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845738001000001, 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:06.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845727299000004, 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:13:06.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845706550000003, 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.936 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:06.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845680688999998, 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:13:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:13:06.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845660852999998, 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.945 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:13:06.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:13:06.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845635229999999, 2024-09-14T07:13:06.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:13:06.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.953 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845596421000003, 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.954 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:13:06.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.845575752000002, 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:13:06.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.840214822, 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:13:06.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:06.967 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.840200267999997, 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:06.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:13:06.971 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:06.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:06.972 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:06.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:06.974 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:06.972+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:07.074 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:07.074+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:07.118 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:07.119 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:07.119 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:07.119 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:07.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:07.212 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:07.211+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:07.271 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:07.271 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:07.271 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:07.276 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:07.276+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:07.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:07.377 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:07.377+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:07.424 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.655877713000002, 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:13:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.654778823999997, 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:13:07.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:13:07.434 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.627935665000003, 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:13:07.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:13:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.614641659999997, 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:13:07.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:13:07.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:13:07.443 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.614572246000002, 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:13:07.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:13:07.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.774194221000002, 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:13:07.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:13:07.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:13:07.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:07.452 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.598602982999999, 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:13:07.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.308538087000002, 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:13:07.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:13:07.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:13:07.461 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.304509789000001, 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:13:07.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.083510666000002, 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.466 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:13:07.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.079992855, 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:13:07.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:71337 3.9 e64/23 3:9465e89a:::rbd_data.118266971d4e.0000000000000124:head v 64'216, mlcod=63'214)", 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.078614141999999, 2024-09-14T07:13:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003270069, 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344127+0000", 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344128+0000", 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8999999999999995e-07 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344145+0000", 2024-09-14T07:13:07.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7317999999999999e-05 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344156+0000", 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1374e-05 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344163+0000", 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3169999999999998e-06 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344209+0000", 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6301999999999998e-05 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.344224+0000", 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5418999999999999e-05 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347364+0000", 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031395490000000002 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:39.347397+0000", 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.29e-05 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.609853874999999, 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.480 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:13:07.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.957490535000002, 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:07.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:13:07.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.618992093999999, 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:13:07.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:13:07.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:13:07.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.613344190999999, 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:07.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:13:07.500 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.875857507999999, 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:13:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.647971607000001, 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:13:07.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:13:07.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:13:07.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.395274833, 2024-09-14T07:13:07.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:13:07.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:13:07.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.353327223000001, 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:13:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.518 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:07.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:07.520 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:07.518+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:07.620 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:07.620+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:07.663 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:07.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:07.664 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:07.664 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:07.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:07.722 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:07.721+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:07.777 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:07.777 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:07.785 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:07.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:13:07.799 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T07:13:07.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T07:13:07.857 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:07.856+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:07.918 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:07.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947547335000003, 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.919 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:13:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:07.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:13:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:13:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:13:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:13:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.926 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.926 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947514982999998, 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:13:07.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:07.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:13:07.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:13:07.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:13:07.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947430332000003, 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:13:07.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:07.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:13:07.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:07.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947404972999998, 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:13:07.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:13:07.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:13:07.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:13:07.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:13:07.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:13:07.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:13:07.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:13:07.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:13:07.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:13:07.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:13:07.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:13:07.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.948 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947372264999998, 2024-09-14T07:13:07.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:13:07.950 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.950 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.951 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:13:07.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.951 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:07.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:07.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:13:07.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:13:07.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.957 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947340140999998, 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:13:07.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:13:07.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:13:07.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947308722999999, 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:13:07.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:13:07.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:13:07.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:13:07.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947284754000002, 2024-09-14T07:13:07.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947265055999999, 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.979 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947251113999997, 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:13:07.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947239883999998, 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:13:07.984 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:13:07.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947228756000001, 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:13:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947217594000001, 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:07.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:07.997 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947206883, 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:07.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:13:08.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947197176000003, 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:08.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:13:08.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:13:08.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947187612, 2024-09-14T07:13:08.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:08.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947178276000002, 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:13:08.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947168083999998, 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:13:08.015 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:13:08.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:13:08.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947147706999999, 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:08.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:13:08.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.947101662999998, 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:08.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:13:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:08.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:08.029 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:08.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:08.030 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:08.030+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:08.031 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:08.131 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:08.130+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:08.136 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:08.136 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:08.136 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:08.136 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:08.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:08.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:08.192 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:08.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:08.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:08.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:08.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:08.232 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:08.231+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:08.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:08.240 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:08.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:08.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:08.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:08.273 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:08.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:08.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:08.290 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:08.290 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:08.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:08.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:08.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:08.340 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:08.339+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:08.434 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:08.433+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:08.441 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:08.441 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:08.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:08.535 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:08.534+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:08.593 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:08.593 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:08.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:08.636 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:08.635+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:08.738 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:08.737+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:08.743 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:08.743 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:08.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:08.800 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:13:08.800 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T07:13:08.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-14T07:13:08.860 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:08.860 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:08.863 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:08.862+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:08.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:08.940 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:08.939+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:08.978 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:08.978 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:08.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:09.040 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:09.040+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:09.089 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.089 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:09.141 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:09.141+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:09.200 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.200 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.208 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:09.243 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:09.242+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:09.343 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:09.342+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:09.350 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.350 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:09.445 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:09.444+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:09.483 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.483 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:09.547 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:09.546+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:09.590 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.591 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:09.646 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:09.646+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:09.711 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.712 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:09.748 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:09.747+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:09.801 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.7 to 1 (10000) 2024-09-14T07:13:09.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T07:13:09.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:13:09.830 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.830 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:09.848 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:09.846+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:09.950 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:09.948+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:09.989 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:09.990 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:09.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:10.051 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:10.050+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:10.103 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:10.103 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:10.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:10.123 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:13:10.135 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-09-14T07:13:09.804533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388392818,"num_objects":1281,"num_object_clones":402,"num_object_copies":2562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":140,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1281,"num_whiteouts":385,"num_read":137467,"num_read_kb":749219,"num_write":16594,"num_write_kb":402437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":6749306,"num_keys_recovered":95,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13407,"ondisk_log_size":13407,"up":82,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":858604,"kb_used_data":559460,"kb_used_omap":20,"kb_used_meta":297899,"kb_avail":754116116,"statfs":{"total":773094113280,"available":772214902784,"internally_reserved":0,"allocated":572887040,"data_stored":705074220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":305049332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-351,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-6,"num_read_kb":-3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":354790,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.041631"},"pg_stats":[{"pgid":"3.1f","version":"84'500","reported_seq":4030,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-14T07:13:04.889038+0000","last_change":"2024-09-14T07:13:04.770900+0000","last_active":"2024-09-14T07:13:04.889038+0000","last_peered":"2024-09-14T07:13:04.889038+0000","last_clean":"2024-09-14T07:12:02.182986+0000","last_became_active":"2024-09-14T07:13:04.770121+0000","last_became_peered":"2024-09-14T07:13:04.770121+0000","last_unstale":"2024-09-14T07:13:04.889038+0000","last_undegraded":"2024-09-14T07:13:04.751988+0000","last_fullsized":"2024-09-14T07:13:04.750355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012858609999999999,"stat_sum":{"num_bytes":34022470,"num_objects":54,"num_object_clones":21,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":21,"num_read":5758,"num_read_kb":29986,"num_write":656,"num_write_kb":17792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'253","reported_seq":4136,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.836794+0000","last_change":"2024-09-14T07:13:03.028660+0000","last_active":"2024-09-14T07:13:04.836794+0000","last_peered":"2024-09-14T07:13:04.836794+0000","last_clean":"2024-09-14T07:13:04.836794+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:13:04.836794+0000","last_undegraded":"2024-09-14T07:13:04.836794+0000","last_fullsized":"2024-09-14T07:13:04.836794+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:03.765764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074899799999999996,"stat_sum":{"num_bytes":31069494,"num_objects":46,"num_object_clones":16,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":15,"num_read":3823,"num_read_kb":18604,"num_write":272,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.1d","version":"84'216","reported_seq":1765,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.771457+0000","last_change":"2024-09-14T07:13:05.771350+0000","last_active":"2024-09-14T07:13:05.771350+0000","last_peered":"2024-09-14T07:13:04.768074+0000","last_clean":"2024-09-14T07:12:01.804976+0000","last_became_active":"2024-09-14T07:13:04.767267+0000","last_became_peered":"2024-09-14T07:13:04.767267+0000","last_unstale":"2024-09-14T07:13:05.771457+0000","last_undegraded":"2024-09-14T07:13:05.771457+0000","last_fullsized":"2024-09-14T07:13:05.771457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001026585,"stat_sum":{"num_bytes":18772275,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":1434,"num_read_kb":8956,"num_write":215,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"84'450","reported_seq":1849,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770904+0000","last_change":"2024-09-14T07:13:05.770782+0000","last_active":"2024-09-14T07:13:05.770782+0000","last_peered":"2024-09-14T07:13:04.886959+0000","last_clean":"2024-09-14T07:12:02.077164+0000","last_became_active":"2024-09-14T07:13:04.770636+0000","last_became_peered":"2024-09-14T07:13:04.770636+0000","last_unstale":"2024-09-14T07:13:05.770904+0000","last_undegraded":"2024-09-14T07:13:05.770904+0000","last_fullsized":"2024-09-14T07:13:05.770904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088611199999999999,"stat_sum":{"num_bytes":64233554,"num_objects":52,"num_object_clones":20,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":2373,"num_read_kb":13266,"num_write":545,"num_write_kb":7975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'237","reported_seq":2633,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750564+0000","last_change":"2024-09-14T07:13:03.030468+0000","last_active":"2024-09-14T07:13:04.750564+0000","last_peered":"2024-09-14T07:13:04.750564+0000","last_clean":"2024-09-14T07:13:04.750564+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:13:04.750564+0000","last_undegraded":"2024-09-14T07:13:04.750564+0000","last_fullsized":"2024-09-14T07:13:04.750564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:16.872908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058474700000000004,"stat_sum":{"num_bytes":50644153,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":2515,"num_read_kb":18862,"num_write":274,"num_write_kb":6318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.1a","version":"84'641","reported_seq":3243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.873870+0000","last_change":"2024-09-14T07:13:02.748453+0000","last_active":"2024-09-14T07:13:04.873870+0000","last_peered":"2024-09-14T07:13:04.873870+0000","last_clean":"2024-09-14T07:13:04.873870+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:13:04.873870+0000","last_undegraded":"2024-09-14T07:13:04.873870+0000","last_fullsized":"2024-09-14T07:13:04.873870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:54:23.920689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021209200000000001,"stat_sum":{"num_bytes":59168785,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":4715,"num_read_kb":27842,"num_write":986,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.19","version":"84'329","reported_seq":4974,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.748841+0000","last_change":"2024-09-14T07:13:02.747466+0000","last_active":"2024-09-14T07:13:04.748841+0000","last_peered":"2024-09-14T07:13:04.748841+0000","last_clean":"2024-09-14T07:13:04.748841+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:13:04.748841+0000","last_undegraded":"2024-09-14T07:13:04.748841+0000","last_fullsized":"2024-09-14T07:13:04.748841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:35.056369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087260099999999998,"stat_sum":{"num_bytes":34847469,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":16,"num_read":5009,"num_read_kb":21132,"num_write":407,"num_write_kb":8863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.18","version":"81'384","reported_seq":2587,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750824+0000","last_change":"2024-09-14T07:13:03.028781+0000","last_active":"2024-09-14T07:13:04.750824+0000","last_peered":"2024-09-14T07:13:04.750824+0000","last_clean":"2024-09-14T07:13:04.750824+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:13:04.750824+0000","last_undegraded":"2024-09-14T07:13:04.750824+0000","last_fullsized":"2024-09-14T07:13:04.750824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:28.817426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058635000000000002,"stat_sum":{"num_bytes":39482281,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":8,"num_read":3707,"num_read_kb":33158,"num_write":454,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.17","version":"84'624","reported_seq":7635,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-14T07:13:04.769431+0000","last_change":"2024-09-14T07:13:04.769431+0000","last_active":"2024-09-14T07:13:04.769431+0000","last_peered":"2024-09-14T07:13:04.769431+0000","last_clean":"2024-09-14T07:12:02.049833+0000","last_became_active":"2024-09-14T07:13:04.768813+0000","last_became_peered":"2024-09-14T07:13:04.768813+0000","last_unstale":"2024-09-14T07:13:04.769431+0000","last_undegraded":"2024-09-14T07:13:04.751727+0000","last_fullsized":"2024-09-14T07:13:04.750218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099453200000000001,"stat_sum":{"num_bytes":37415970,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":62,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":9620,"num_read_kb":40599,"num_write":808,"num_write_kb":14493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'434","reported_seq":2229,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770611+0000","last_change":"2024-09-14T07:13:05.770139+0000","last_active":"2024-09-14T07:13:05.770139+0000","last_peered":"2024-09-14T07:13:04.831258+0000","last_clean":"2024-09-14T07:12:02.114005+0000","last_became_active":"2024-09-14T07:13:04.766946+0000","last_became_peered":"2024-09-14T07:13:04.766946+0000","last_unstale":"2024-09-14T07:13:05.770611+0000","last_undegraded":"2024-09-14T07:13:05.770611+0000","last_fullsized":"2024-09-14T07:13:05.770611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106477,"stat_sum":{"num_bytes":22919358,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":3185,"num_read_kb":8586,"num_write":580,"num_write_kb":4095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'301","reported_seq":1087,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.752448+0000","last_change":"2024-09-14T07:13:03.030600+0000","last_active":"2024-09-14T07:13:04.752448+0000","last_peered":"2024-09-14T07:13:04.752448+0000","last_clean":"2024-09-14T07:13:04.752448+0000","last_became_active":"2024-09-14T07:12:15.764942+0000","last_became_peered":"2024-09-14T07:12:15.764942+0000","last_unstale":"2024-09-14T07:13:04.752448+0000","last_undegraded":"2024-09-14T07:13:04.752448+0000","last_fullsized":"2024-09-14T07:13:04.752448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:29.179177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000401207,"stat_sum":{"num_bytes":30243855,"num_objects":33,"num_object_clones":10,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":10,"num_read":1323,"num_read_kb":15086,"num_write":369,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.14","version":"75'694","reported_seq":3468,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.753017+0000","last_change":"2024-09-14T07:13:02.749779+0000","last_active":"2024-09-14T07:13:04.753017+0000","last_peered":"2024-09-14T07:13:04.753017+0000","last_clean":"2024-09-14T07:13:04.753017+0000","last_became_active":"2024-09-14T07:11:51.642949+0000","last_became_peered":"2024-09-14T07:11:51.642949+0000","last_unstale":"2024-09-14T07:13:04.753017+0000","last_undegraded":"2024-09-14T07:13:04.753017+0000","last_fullsized":"2024-09-14T07:13:04.753017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:56.774495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001829956,"stat_sum":{"num_bytes":40288250,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":13,"num_read":5375,"num_read_kb":29469,"num_write":1094,"num_write_kb":9271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.836772+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:13:04.836772+0000","last_peered":"2024-09-14T07:13:04.836772+0000","last_clean":"2024-09-14T07:13:04.836772+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:13:04.836772+0000","last_undegraded":"2024-09-14T07:13:04.836772+0000","last_fullsized":"2024-09-14T07:13:04.836772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"84'735","reported_seq":3852,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.874308+0000","last_change":"2024-09-14T07:13:03.030904+0000","last_active":"2024-09-14T07:13:04.874308+0000","last_peered":"2024-09-14T07:13:04.874308+0000","last_clean":"2024-09-14T07:13:04.874308+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:13:04.874308+0000","last_undegraded":"2024-09-14T07:13:04.874308+0000","last_fullsized":"2024-09-14T07:13:04.874308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:58.098035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066998000000000003,"stat_sum":{"num_bytes":46216765,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":6611,"num_read_kb":28952,"num_write":903,"num_write_kb":10646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.749075+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:13:04.749075+0000","last_peered":"2024-09-14T07:13:04.749075+0000","last_clean":"2024-09-14T07:13:04.749075+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:13:04.749075+0000","last_undegraded":"2024-09-14T07:13:04.749075+0000","last_fullsized":"2024-09-14T07:13:04.749075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"84'308","reported_seq":4512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.751294+0000","last_change":"2024-09-14T07:13:03.028817+0000","last_active":"2024-09-14T07:13:04.751294+0000","last_peered":"2024-09-14T07:13:04.751294+0000","last_clean":"2024-09-14T07:13:04.751294+0000","last_became_active":"2024-09-14T07:11:51.646069+0000","last_became_peered":"2024-09-14T07:11:51.646069+0000","last_unstale":"2024-09-14T07:13:04.751294+0000","last_undegraded":"2024-09-14T07:13:04.751294+0000","last_fullsized":"2024-09-14T07:13:04.751294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:30.517904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044170800000000002,"stat_sum":{"num_bytes":24989957,"num_objects":37,"num_object_clones":14,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":12,"num_read":5380,"num_read_kb":21552,"num_write":303,"num_write_kb":6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750074+0000","last_change":"2024-09-14T07:12:15.765521+0000","last_active":"2024-09-14T07:13:04.750074+0000","last_peered":"2024-09-14T07:13:04.750074+0000","last_clean":"2024-09-14T07:13:04.750074+0000","last_became_active":"2024-09-14T07:12:15.765216+0000","last_became_peered":"2024-09-14T07:12:15.765216+0000","last_unstale":"2024-09-14T07:13:04.750074+0000","last_undegraded":"2024-09-14T07:13:04.750074+0000","last_fullsized":"2024-09-14T07:13:04.750074+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.152750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"84'863","reported_seq":4490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.842424+0000","last_change":"2024-09-14T07:13:02.747687+0000","last_active":"2024-09-14T07:13:04.842424+0000","last_peered":"2024-09-14T07:13:04.842424+0000","last_clean":"2024-09-14T07:13:04.842424+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:13:04.842424+0000","last_undegraded":"2024-09-14T07:13:04.842424+0000","last_fullsized":"2024-09-14T07:13:04.842424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:50.816513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010307020000000001,"stat_sum":{"num_bytes":57751833,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":8148,"num_read_kb":22480,"num_write":1194,"num_write_kb":11165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.749002+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:13:04.749002+0000","last_peered":"2024-09-14T07:13:04.749002+0000","last_clean":"2024-09-14T07:13:04.749002+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:13:04.749002+0000","last_undegraded":"2024-09-14T07:13:04.749002+0000","last_fullsized":"2024-09-14T07:13:04.749002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'500","reported_seq":1110,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770618+0000","last_change":"2024-09-14T07:13:05.770618+0000","last_active":"2024-09-14T07:13:03.752449+0000","last_peered":"2024-09-14T07:13:01.746230+0000","last_clean":"2024-09-14T07:12:02.196630+0000","last_became_active":"2024-09-14T07:12:03.695737+0000","last_became_peered":"2024-09-14T07:12:03.695737+0000","last_unstale":"2024-09-14T07:13:05.770618+0000","last_undegraded":"2024-09-14T07:13:05.770618+0000","last_fullsized":"2024-09-14T07:13:05.770618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094557899999999999,"stat_sum":{"num_bytes":25621307,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":1963,"num_read_kb":11504,"num_write":698,"num_write_kb":14788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"84'300","reported_seq":2370,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.852311+0000","last_change":"2024-09-14T07:13:02.749867+0000","last_active":"2024-09-14T07:13:04.852311+0000","last_peered":"2024-09-14T07:13:04.852311+0000","last_clean":"2024-09-14T07:13:04.852311+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:13:04.852311+0000","last_undegraded":"2024-09-14T07:13:04.852311+0000","last_fullsized":"2024-09-14T07:13:04.852311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:28.453665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019104879999999999,"stat_sum":{"num_bytes":58970966,"num_objects":42,"num_object_clones":13,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":2104,"num_read_kb":22213,"num_write":379,"num_write_kb":18994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.2","version":"22'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T07:13:05.769164+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:13:05.769164+0000","last_peered":"2024-09-14T07:13:05.769164+0000","last_clean":"2024-09-14T07:13:05.769164+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:13:05.769164+0000","last_undegraded":"2024-09-14T07:13:05.769164+0000","last_fullsized":"2024-09-14T07:13:05.769164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"84'238","reported_seq":4019,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.748852+0000","last_change":"2024-09-14T07:13:02.747412+0000","last_active":"2024-09-14T07:13:04.748852+0000","last_peered":"2024-09-14T07:13:04.748852+0000","last_clean":"2024-09-14T07:13:04.748852+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:13:04.748852+0000","last_undegraded":"2024-09-14T07:13:04.748852+0000","last_fullsized":"2024-09-14T07:13:04.748852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:49.143010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015821190000000001,"stat_sum":{"num_bytes":56253132,"num_objects":39,"num_object_clones":14,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":3989,"num_read_kb":27789,"num_write":226,"num_write_kb":9458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.748069+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:13:04.748069+0000","last_peered":"2024-09-14T07:13:04.748069+0000","last_clean":"2024-09-14T07:13:04.748069+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:13:04.748069+0000","last_undegraded":"2024-09-14T07:13:04.748069+0000","last_fullsized":"2024-09-14T07:13:04.748069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'254","reported_seq":3197,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750683+0000","last_change":"2024-09-14T07:13:03.031235+0000","last_active":"2024-09-14T07:13:04.750683+0000","last_peered":"2024-09-14T07:13:04.750683+0000","last_clean":"2024-09-14T07:13:04.750683+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:13:04.750683+0000","last_undegraded":"2024-09-14T07:13:04.750683+0000","last_fullsized":"2024-09-14T07:13:04.750683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:41.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040827000000000002,"stat_sum":{"num_bytes":47099771,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":3287,"num_read_kb":29042,"num_write":281,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.748908+0000","last_change":"2024-09-14T07:12:15.765297+0000","last_active":"2024-09-14T07:13:04.748908+0000","last_peered":"2024-09-14T07:13:04.748908+0000","last_clean":"2024-09-14T07:13:04.748908+0000","last_became_active":"2024-09-14T07:12:15.765018+0000","last_became_peered":"2024-09-14T07:12:15.765018+0000","last_unstale":"2024-09-14T07:13:04.748908+0000","last_undegraded":"2024-09-14T07:13:04.748908+0000","last_fullsized":"2024-09-14T07:13:04.748908+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:02.766098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"78'283","reported_seq":1592,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:04.875604+0000","last_change":"2024-09-14T07:13:06.741658+0000","last_active":"2024-09-14T07:13:06.741658+0000","last_peered":"2024-09-14T07:13:04.875604+0000","last_clean":"2024-09-14T07:12:02.182931+0000","last_became_active":"2024-09-14T07:13:04.766609+0000","last_became_peered":"2024-09-14T07:13:04.766609+0000","last_unstale":"2024-09-14T07:13:04.875604+0000","last_undegraded":"2024-09-14T07:13:04.875604+0000","last_fullsized":"2024-09-14T07:13:04.749693+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076532499999999997,"stat_sum":{"num_bytes":23306342,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":1603,"num_read_kb":10858,"num_write":341,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T07:13:05.769977+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:13:05.769977+0000","last_peered":"2024-09-14T07:13:05.769977+0000","last_clean":"2024-09-14T07:13:05.769977+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:13:05.769977+0000","last_undegraded":"2024-09-14T07:13:05.769977+0000","last_fullsized":"2024-09-14T07:13:05.769977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750930+0000","last_change":"2024-09-14T07:12:15.764696+0000","last_active":"2024-09-14T07:13:04.750930+0000","last_peered":"2024-09-14T07:13:04.750930+0000","last_clean":"2024-09-14T07:13:04.750930+0000","last_became_active":"2024-09-14T07:12:15.764436+0000","last_became_peered":"2024-09-14T07:12:15.764436+0000","last_unstale":"2024-09-14T07:13:04.750930+0000","last_undegraded":"2024-09-14T07:13:04.750930+0000","last_fullsized":"2024-09-14T07:13:04.750930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"84'402","reported_seq":2960,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750132+0000","last_change":"2024-09-14T07:13:03.030829+0000","last_active":"2024-09-14T07:13:04.750132+0000","last_peered":"2024-09-14T07:13:04.750132+0000","last_clean":"2024-09-14T07:13:04.750132+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:13:04.750132+0000","last_undegraded":"2024-09-14T07:13:04.750132+0000","last_fullsized":"2024-09-14T07:13:04.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:25.736886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056275300000000004,"stat_sum":{"num_bytes":19269315,"num_objects":38,"num_object_clones":13,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":10,"num_read":4473,"num_read_kb":17743,"num_write":482,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.9","version":"84'481","reported_seq":4108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.846420+0000","last_change":"2024-09-14T07:13:02.749492+0000","last_active":"2024-09-14T07:13:04.846420+0000","last_peered":"2024-09-14T07:13:04.846420+0000","last_clean":"2024-09-14T07:13:04.846420+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:13:04.846420+0000","last_undegraded":"2024-09-14T07:13:04.846420+0000","last_fullsized":"2024-09-14T07:13:04.846420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:16.839263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020748569999999998,"stat_sum":{"num_bytes":51033800,"num_objects":50,"num_object_clones":16,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":18,"num_read":6341,"num_read_kb":37125,"num_write":473,"num_write_kb":19491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.a","version":"78'337","reported_seq":1955,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.836727+0000","last_change":"2024-09-14T07:13:03.028636+0000","last_active":"2024-09-14T07:13:04.836727+0000","last_peered":"2024-09-14T07:13:04.836727+0000","last_clean":"2024-09-14T07:13:04.836727+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:13:04.836727+0000","last_undegraded":"2024-09-14T07:13:04.836727+0000","last_fullsized":"2024-09-14T07:13:04.836727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:35:18.365816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075414099999999995,"stat_sum":{"num_bytes":74301252,"num_objects":42,"num_object_clones":16,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1915,"num_read_kb":55142,"num_write":396,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.b","version":"84'260","reported_seq":2485,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.837545+0000","last_change":"2024-09-14T07:13:03.030288+0000","last_active":"2024-09-14T07:13:04.837545+0000","last_peered":"2024-09-14T07:13:04.837545+0000","last_clean":"2024-09-14T07:13:04.837545+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:13:04.837545+0000","last_undegraded":"2024-09-14T07:13:04.837545+0000","last_fullsized":"2024-09-14T07:13:04.837545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:25.494628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045652099999999999,"stat_sum":{"num_bytes":84182234,"num_objects":41,"num_object_clones":13,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":13,"num_read":2115,"num_read_kb":21709,"num_write":266,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.c","version":"84'655","reported_seq":5873,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770232+0000","last_change":"2024-09-14T07:13:05.770123+0000","last_active":"2024-09-14T07:13:05.770123+0000","last_peered":"2024-09-14T07:13:04.889961+0000","last_clean":"2024-09-14T07:12:02.167669+0000","last_became_active":"2024-09-14T07:13:04.771059+0000","last_became_peered":"2024-09-14T07:13:04.771059+0000","last_unstale":"2024-09-14T07:13:05.770232+0000","last_undegraded":"2024-09-14T07:13:05.770232+0000","last_fullsized":"2024-09-14T07:13:05.770232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081047900000000002,"stat_sum":{"num_bytes":65121506,"num_objects":45,"num_object_clones":15,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":14,"num_read":7770,"num_read_kb":25202,"num_write":912,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"81'537","reported_seq":6203,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.312805+0000","last_change":"2024-09-14T07:13:06.741711+0000","last_active":"2024-09-14T07:13:06.741711+0000","last_peered":"2024-09-14T07:13:05.312805+0000","last_clean":"2024-09-14T07:12:02.196725+0000","last_became_active":"2024-09-14T07:13:04.768025+0000","last_became_peered":"2024-09-14T07:13:04.768025+0000","last_unstale":"2024-09-14T07:13:05.312805+0000","last_undegraded":"2024-09-14T07:13:05.312805+0000","last_fullsized":"2024-09-14T07:13:04.749545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072059800000000003,"stat_sum":{"num_bytes":32745120,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":9038,"num_read_kb":24422,"num_write":567,"num_write_kb":3792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1812153,"num_keys_recovered":60,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'168","reported_seq":2191,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.749620+0000","last_change":"2024-09-14T07:13:02.748978+0000","last_active":"2024-09-14T07:13:04.749620+0000","last_peered":"2024-09-14T07:13:04.749620+0000","last_clean":"2024-09-14T07:13:04.749620+0000","last_became_active":"2024-09-14T07:12:15.765001+0000","last_became_peered":"2024-09-14T07:12:15.765001+0000","last_unstale":"2024-09-14T07:13:04.749620+0000","last_undegraded":"2024-09-14T07:13:04.749620+0000","last_fullsized":"2024-09-14T07:13:04.749620+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:52.233238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002110467,"stat_sum":{"num_bytes":43378228,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":2296,"num_read_kb":24533,"num_write":156,"num_write_kb":11223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.f","version":"84'473","reported_seq":4385,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.831410+0000","last_change":"2024-09-14T07:13:02.748755+0000","last_active":"2024-09-14T07:13:04.831410+0000","last_peered":"2024-09-14T07:13:04.831410+0000","last_clean":"2024-09-14T07:13:04.831410+0000","last_became_active":"2024-09-14T07:12:15.764966+0000","last_became_peered":"2024-09-14T07:12:15.764966+0000","last_unstale":"2024-09-14T07:13:04.831410+0000","last_undegraded":"2024-09-14T07:13:04.831410+0000","last_fullsized":"2024-09-14T07:13:04.831410+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:24.829912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021304309999999999,"stat_sum":{"num_bytes":57084557,"num_objects":50,"num_object_clones":18,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":5402,"num_read_kb":18736,"num_write":538,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.10","version":"81'567","reported_seq":2731,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.836792+0000","last_change":"2024-09-14T07:13:03.028982+0000","last_active":"2024-09-14T07:13:04.836792+0000","last_peered":"2024-09-14T07:13:04.836792+0000","last_clean":"2024-09-14T07:13:04.836792+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:13:04.836792+0000","last_undegraded":"2024-09-14T07:13:04.836792+0000","last_fullsized":"2024-09-14T07:13:04.836792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:30.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098513300000000002,"stat_sum":{"num_bytes":23697968,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":4180,"num_read_kb":14720,"num_write":778,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.11","version":"81'243","reported_seq":2748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.750187+0000","last_change":"2024-09-14T07:13:02.749043+0000","last_active":"2024-09-14T07:13:04.750187+0000","last_peered":"2024-09-14T07:13:04.750187+0000","last_clean":"2024-09-14T07:13:04.750187+0000","last_became_active":"2024-09-14T07:12:15.764948+0000","last_became_peered":"2024-09-14T07:12:15.764948+0000","last_unstale":"2024-09-14T07:13:04.750187+0000","last_undegraded":"2024-09-14T07:13:04.750187+0000","last_fullsized":"2024-09-14T07:13:04.750187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:58:40.547369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002128254,"stat_sum":{"num_bytes":70269929,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":2703,"num_read_kb":42528,"num_write":255,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.12","version":"79'314","reported_seq":4399,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.867972+0000","last_change":"2024-09-14T07:13:02.748529+0000","last_active":"2024-09-14T07:13:04.867972+0000","last_peered":"2024-09-14T07:13:04.867972+0000","last_clean":"2024-09-14T07:13:04.867972+0000","last_became_active":"2024-09-14T07:12:44.655369+0000","last_became_peered":"2024-09-14T07:12:44.655369+0000","last_unstale":"2024-09-14T07:13:04.867972+0000","last_undegraded":"2024-09-14T07:13:04.867972+0000","last_fullsized":"2024-09-14T07:13:04.867972+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:25.590329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025773559999999998,"stat_sum":{"num_bytes":11555226,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":15,"num_read":5889,"num_read_kb":8719,"num_write":308,"num_write_kb":6019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":1502781,"num_keys_recovered":35,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]},{"pgid":"3.13","version":"80'351","reported_seq":3150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T07:13:04.749946+0000","last_change":"2024-09-14T07:13:02.749606+0000","last_active":"2024-09-14T07:13:04.749946+0000","last_peered":"2024-09-14T07:13:04.749946+0000","last_clean":"2024-09-14T07:13:04.749946+0000","last_became_active":"2024-09-14T07:12:15.765178+0000","last_became_peered":"2024-09-14T07:12:15.765178+0000","last_unstale":"2024-09-14T07:13:04.749946+0000","last_undegraded":"2024-09-14T07:13:04.749946+0000","last_fullsized":"2024-09-14T07:13:04.749946+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:52.242508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020197290000000001,"stat_sum":{"num_bytes":51845309,"num_objects":41,"num_object_clones":13,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":13,"num_read":3357,"num_read_kb":18649,"num_write":375,"num_write_kb":6992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"4"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1387802431,"num_objects":1277,"num_object_clones":402,"num_object_copies":2554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":140,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1277,"num_whiteouts":385,"num_read":137401,"num_read_kb":749164,"num_write":16491,"num_write_kb":400807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":6749306,"num_keys_recovered":95,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":558538752,"data_stored":695149232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":13332,"ondisk_log_size":13332,"up":64,"acting":62,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113764,"kb_used_data":70096,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94258076,"statfs":{"total":96636764160,"available":96520269824,"internally_reserved":0,"allocated":71778304,"data_stored":87043436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":44693963},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72820,"kb_used_data":40592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94299020,"statfs":{"total":96636764160,"available":96562196480,"internally_reserved":0,"allocated":41566208,"data_stored":49101938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318274,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95180,"kb_used_data":62584,"kb_used_omap":9,"kb_used_meta":32566,"kb_avail":94276660,"statfs":{"total":96636764160,"available":96539299840,"internally_reserved":0,"allocated":64086016,"data_stored":78374057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":33348232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189104,"kb_used_data":139868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94182736,"statfs":{"total":96636764160,"available":96443121664,"internally_reserved":0,"allocated":143224832,"data_stored":170464912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116844,"kb_used_data":77328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94254996,"statfs":{"total":96636764160,"available":96517115904,"internally_reserved":0,"allocated":79183872,"data_stored":100013403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68968,"kb_used_data":33616,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94302872,"statfs":{"total":96636764160,"available":96566140928,"internally_reserved":0,"allocated":34422784,"data_stored":45398579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89788,"kb_used_data":50272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94282052,"statfs":{"total":96636764160,"available":96544821248,"internally_reserved":0,"allocated":51478528,"data_stored":69426803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112136,"kb_used_data":85104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94259704,"statfs":{"total":96636764160,"available":96521936896,"internally_reserved":0,"allocated":87146496,"data_stored":105251092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":84832256,"data_stored":103498069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49045504,"data_stored":67557552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32882688,"data_stored":44397102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77234176,"data_stored":98639232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":141766656,"data_stored":169560356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63082496,"data_stored":77911094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40505344,"data_stored":48577723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69189632,"data_stored":85008104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:13:10.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:13:10.176 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:10.175+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:10.227 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:10.227 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:10.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:10.280 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:10.279+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:10.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:10.344 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:10.344 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:10.354 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:10.355 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:10.352+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:10.442 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:10.454 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:10.453+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:10.459 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:10.459 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:13:10.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:10.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:10.486 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-14T07:13:10.357237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1155703043,"num_objects":1208,"num_object_clones":392,"num_object_copies":2416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":379,"num_read":138260,"num_read_kb":749894,"num_write":16749,"num_write_kb":402476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":30104779,"num_keys_recovered":130,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13598,"ondisk_log_size":13598,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":732800,"kb_used_data":451228,"kb_used_omap":20,"kb_used_meta":281259,"kb_avail":754241920,"statfs":{"total":773094113280,"available":772343726080,"internally_reserved":0,"allocated":462057472,"data_stored":568756771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":288009972},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-232689775,"num_objects":-73,"num_object_clones":-10,"num_object_copies":-146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-491,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-73,"num_whiteouts":-6,"num_read":787,"num_read_kb":672,"num_write":155,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":23710263,"num_keys_recovered":95,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000866"},"pg_stats":[{"pgid":"3.1f","version":"89'522","reported_seq":4312,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815543+0000","last_change":"2024-09-14T07:13:09.815543+0000","last_active":"2024-09-14T07:13:09.815543+0000","last_peered":"2024-09-14T07:13:09.815543+0000","last_clean":"2024-09-14T07:13:09.815543+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:13:09.815543+0000","last_undegraded":"2024-09-14T07:13:09.815543+0000","last_fullsized":"2024-09-14T07:13:09.815543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:08.956266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011994530000000001,"stat_sum":{"num_bytes":28484678,"num_objects":49,"num_object_clones":20,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":20,"num_read":5858,"num_read_kb":30075,"num_write":669,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1e","version":"89'255","reported_seq":4169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.882320+0000","last_change":"2024-09-14T07:13:09.882320+0000","last_active":"2024-09-14T07:13:09.882320+0000","last_peered":"2024-09-14T07:13:09.882320+0000","last_clean":"2024-09-14T07:13:09.882320+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:13:09.882320+0000","last_undegraded":"2024-09-14T07:13:09.882320+0000","last_fullsized":"2024-09-14T07:13:09.882320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.961500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021217290000000001,"stat_sum":{"num_bytes":27760179,"num_objects":44,"num_object_clones":16,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":15,"num_read":3825,"num_read_kb":18605,"num_write":274,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1d","version":"84'216","reported_seq":1765,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.771457+0000","last_change":"2024-09-14T07:13:05.771350+0000","last_active":"2024-09-14T07:13:05.771350+0000","last_peered":"2024-09-14T07:13:04.768074+0000","last_clean":"2024-09-14T07:12:01.804976+0000","last_became_active":"2024-09-14T07:13:04.767267+0000","last_became_peered":"2024-09-14T07:13:04.767267+0000","last_unstale":"2024-09-14T07:13:05.771457+0000","last_undegraded":"2024-09-14T07:13:05.771457+0000","last_fullsized":"2024-09-14T07:13:05.771457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001026585,"stat_sum":{"num_bytes":18772275,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":1434,"num_read_kb":8956,"num_write":215,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"84'450","reported_seq":1849,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770904+0000","last_change":"2024-09-14T07:13:05.770782+0000","last_active":"2024-09-14T07:13:05.770782+0000","last_peered":"2024-09-14T07:13:04.886959+0000","last_clean":"2024-09-14T07:12:02.077164+0000","last_became_active":"2024-09-14T07:13:04.770636+0000","last_became_peered":"2024-09-14T07:13:04.770636+0000","last_unstale":"2024-09-14T07:13:05.770904+0000","last_undegraded":"2024-09-14T07:13:05.770904+0000","last_fullsized":"2024-09-14T07:13:05.770904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088611199999999999,"stat_sum":{"num_bytes":64233554,"num_objects":52,"num_object_clones":20,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":2373,"num_read_kb":13266,"num_write":545,"num_write_kb":7975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"89'239","reported_seq":2665,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815274+0000","last_change":"2024-09-14T07:13:09.815274+0000","last_active":"2024-09-14T07:13:09.815274+0000","last_peered":"2024-09-14T07:13:09.815274+0000","last_clean":"2024-09-14T07:13:09.815274+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:13:09.815274+0000","last_undegraded":"2024-09-14T07:13:09.815274+0000","last_fullsized":"2024-09-14T07:13:09.815274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:36.667442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011608580000000001,"stat_sum":{"num_bytes":15079695,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":2515,"num_read_kb":18862,"num_write":276,"num_write_kb":6318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1a","version":"84'641","reported_seq":3305,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.847756+0000","last_change":"2024-09-14T07:13:09.825841+0000","last_active":"2024-09-14T07:13:09.847756+0000","last_peered":"2024-09-14T07:13:09.847756+0000","last_clean":"2024-09-14T07:13:09.847756+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:13:09.847756+0000","last_undegraded":"2024-09-14T07:13:09.847756+0000","last_fullsized":"2024-09-14T07:13:09.847756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:22.508419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010313329999999999,"stat_sum":{"num_bytes":59168785,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":4748,"num_read_kb":27874,"num_write":986,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.19","version":"89'330","reported_seq":5005,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806727+0000","last_change":"2024-09-14T07:13:09.806727+0000","last_active":"2024-09-14T07:13:09.806727+0000","last_peered":"2024-09-14T07:13:09.806727+0000","last_clean":"2024-09-14T07:13:09.806727+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:13:09.806727+0000","last_undegraded":"2024-09-14T07:13:09.806727+0000","last_fullsized":"2024-09-14T07:13:09.806727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:47.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042086000000000001,"stat_sum":{"num_bytes":33962733,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":16,"num_read":5009,"num_read_kb":21132,"num_write":408,"num_write_kb":8863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.18","version":"89'401","reported_seq":2638,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.888069+0000","last_change":"2024-09-14T07:13:09.815020+0000","last_active":"2024-09-14T07:13:09.888069+0000","last_peered":"2024-09-14T07:13:09.888069+0000","last_clean":"2024-09-14T07:13:09.888069+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:13:09.888069+0000","last_undegraded":"2024-09-14T07:13:09.888069+0000","last_fullsized":"2024-09-14T07:13:09.888069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:33.132990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00120506,"stat_sum":{"num_bytes":31752725,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":3738,"num_read_kb":33182,"num_write":471,"num_write_kb":15663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.17","version":"89'640","reported_seq":7832,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815814+0000","last_change":"2024-09-14T07:13:09.815814+0000","last_active":"2024-09-14T07:13:09.815814+0000","last_peered":"2024-09-14T07:13:09.815814+0000","last_clean":"2024-09-14T07:13:09.815814+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:13:09.815814+0000","last_undegraded":"2024-09-14T07:13:09.815814+0000","last_fullsized":"2024-09-14T07:13:09.815814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:56.390045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014065480000000001,"stat_sum":{"num_bytes":29239636,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":7,"num_read":9651,"num_read_kb":40623,"num_write":824,"num_write_kb":14498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.16","version":"84'434","reported_seq":2229,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770611+0000","last_change":"2024-09-14T07:13:05.770139+0000","last_active":"2024-09-14T07:13:05.770139+0000","last_peered":"2024-09-14T07:13:04.831258+0000","last_clean":"2024-09-14T07:12:02.114005+0000","last_became_active":"2024-09-14T07:13:04.766946+0000","last_became_peered":"2024-09-14T07:13:04.766946+0000","last_unstale":"2024-09-14T07:13:05.770611+0000","last_undegraded":"2024-09-14T07:13:05.770611+0000","last_fullsized":"2024-09-14T07:13:05.770611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106477,"stat_sum":{"num_bytes":22919358,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":3185,"num_read_kb":8586,"num_write":580,"num_write_kb":4095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'303","reported_seq":1119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.817193+0000","last_change":"2024-09-14T07:13:09.817193+0000","last_active":"2024-09-14T07:13:09.817193+0000","last_peered":"2024-09-14T07:13:09.817193+0000","last_clean":"2024-09-14T07:13:09.817193+0000","last_became_active":"2024-09-14T07:12:15.764942+0000","last_became_peered":"2024-09-14T07:12:15.764942+0000","last_unstale":"2024-09-14T07:13:09.817193+0000","last_undegraded":"2024-09-14T07:13:09.817193+0000","last_fullsized":"2024-09-14T07:13:09.817193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:57.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044608799999999997,"stat_sum":{"num_bytes":25099279,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1323,"num_read_kb":15086,"num_write":371,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.14","version":"89'708","reported_seq":3516,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825883+0000","last_change":"2024-09-14T07:13:09.825883+0000","last_active":"2024-09-14T07:13:09.825883+0000","last_peered":"2024-09-14T07:13:09.825883+0000","last_clean":"2024-09-14T07:13:09.825883+0000","last_became_active":"2024-09-14T07:11:51.642949+0000","last_became_peered":"2024-09-14T07:11:51.642949+0000","last_unstale":"2024-09-14T07:13:09.825883+0000","last_undegraded":"2024-09-14T07:13:09.825883+0000","last_fullsized":"2024-09-14T07:13:09.825883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:47:05.664837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010494320000000001,"stat_sum":{"num_bytes":29508843,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":5406,"num_read_kb":29493,"num_write":1109,"num_write_kb":9275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.880136+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:13:09.880136+0000","last_peered":"2024-09-14T07:13:09.880136+0000","last_clean":"2024-09-14T07:13:09.880136+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:13:09.880136+0000","last_undegraded":"2024-09-14T07:13:09.880136+0000","last_fullsized":"2024-09-14T07:13:09.880136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"89'762","reported_seq":3990,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815632+0000","last_change":"2024-09-14T07:13:09.815632+0000","last_active":"2024-09-14T07:13:09.815632+0000","last_peered":"2024-09-14T07:13:09.815632+0000","last_clean":"2024-09-14T07:13:09.815632+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:13:09.815632+0000","last_undegraded":"2024-09-14T07:13:09.815632+0000","last_fullsized":"2024-09-14T07:13:09.815632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.528280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014962790000000001,"stat_sum":{"num_bytes":46216749,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":6819,"num_read_kb":29133,"num_write":921,"num_write_kb":10652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806158+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:13:09.806158+0000","last_peered":"2024-09-14T07:13:09.806158+0000","last_clean":"2024-09-14T07:13:09.806158+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:13:09.806158+0000","last_undegraded":"2024-09-14T07:13:09.806158+0000","last_fullsized":"2024-09-14T07:13:09.806158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"89'311","reported_seq":4557,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.816658+0000","last_change":"2024-09-14T07:13:09.816658+0000","last_active":"2024-09-14T07:13:09.816658+0000","last_peered":"2024-09-14T07:13:09.816658+0000","last_clean":"2024-09-14T07:13:09.816658+0000","last_became_active":"2024-09-14T07:11:51.646069+0000","last_became_peered":"2024-09-14T07:11:51.646069+0000","last_unstale":"2024-09-14T07:13:09.816658+0000","last_undegraded":"2024-09-14T07:13:09.816658+0000","last_fullsized":"2024-09-14T07:13:09.816658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:38.258049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673999999999999,"stat_sum":{"num_bytes":19823261,"num_objects":34,"num_object_clones":14,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":5417,"num_read_kb":21582,"num_write":306,"num_write_kb":6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.813898+0000","last_change":"2024-09-14T07:12:15.765521+0000","last_active":"2024-09-14T07:13:09.813898+0000","last_peered":"2024-09-14T07:13:09.813898+0000","last_clean":"2024-09-14T07:13:09.813898+0000","last_became_active":"2024-09-14T07:12:15.765216+0000","last_became_peered":"2024-09-14T07:12:15.765216+0000","last_unstale":"2024-09-14T07:13:09.813898+0000","last_undegraded":"2024-09-14T07:13:09.813898+0000","last_fullsized":"2024-09-14T07:13:09.813898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.152750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'867","reported_seq":4536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806841+0000","last_change":"2024-09-14T07:13:09.806841+0000","last_active":"2024-09-14T07:13:09.806841+0000","last_peered":"2024-09-14T07:13:09.806841+0000","last_clean":"2024-09-14T07:13:09.806841+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:13:09.806841+0000","last_undegraded":"2024-09-14T07:13:09.806841+0000","last_fullsized":"2024-09-14T07:13:09.806841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:16.413345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043783899999999998,"stat_sum":{"num_bytes":32910285,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":11,"num_read":8187,"num_read_kb":22512,"num_write":1196,"num_write_kb":11165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806665+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:13:09.806665+0000","last_peered":"2024-09-14T07:13:09.806665+0000","last_clean":"2024-09-14T07:13:09.806665+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:13:09.806665+0000","last_undegraded":"2024-09-14T07:13:09.806665+0000","last_fullsized":"2024-09-14T07:13:09.806665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'500","reported_seq":1110,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770618+0000","last_change":"2024-09-14T07:13:05.770618+0000","last_active":"2024-09-14T07:13:03.752449+0000","last_peered":"2024-09-14T07:13:01.746230+0000","last_clean":"2024-09-14T07:12:02.196630+0000","last_became_active":"2024-09-14T07:12:03.695737+0000","last_became_peered":"2024-09-14T07:12:03.695737+0000","last_unstale":"2024-09-14T07:13:05.770618+0000","last_undegraded":"2024-09-14T07:13:05.770618+0000","last_fullsized":"2024-09-14T07:13:05.770618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094557899999999999,"stat_sum":{"num_bytes":25621307,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":1963,"num_read_kb":11504,"num_write":698,"num_write_kb":14788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'319","reported_seq":2435,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881703+0000","last_change":"2024-09-14T07:13:09.825590+0000","last_active":"2024-09-14T07:13:09.881703+0000","last_peered":"2024-09-14T07:13:09.881703+0000","last_clean":"2024-09-14T07:13:09.881703+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:13:09.881703+0000","last_undegraded":"2024-09-14T07:13:09.881703+0000","last_fullsized":"2024-09-14T07:13:09.881703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:20.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095568200000000002,"stat_sum":{"num_bytes":50647894,"num_objects":38,"num_object_clones":13,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":2127,"num_read_kb":22236,"num_write":398,"num_write_kb":19006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.2","version":"22'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T07:13:05.769164+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:13:05.769164+0000","last_peered":"2024-09-14T07:13:05.769164+0000","last_clean":"2024-09-14T07:13:05.769164+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:13:05.769164+0000","last_undegraded":"2024-09-14T07:13:05.769164+0000","last_fullsized":"2024-09-14T07:13:05.769164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'239","reported_seq":4050,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806526+0000","last_change":"2024-09-14T07:13:09.806526+0000","last_active":"2024-09-14T07:13:09.806526+0000","last_peered":"2024-09-14T07:13:09.806526+0000","last_clean":"2024-09-14T07:13:09.806526+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:13:09.806526+0000","last_undegraded":"2024-09-14T07:13:09.806526+0000","last_fullsized":"2024-09-14T07:13:09.806526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:12.384277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047440200000000002,"stat_sum":{"num_bytes":55073484,"num_objects":38,"num_object_clones":14,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":3989,"num_read_kb":27789,"num_write":227,"num_write_kb":9458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.805897+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:13:09.805897+0000","last_peered":"2024-09-14T07:13:09.805897+0000","last_clean":"2024-09-14T07:13:09.805897+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:13:09.805897+0000","last_undegraded":"2024-09-14T07:13:09.805897+0000","last_fullsized":"2024-09-14T07:13:09.805897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'254","reported_seq":3227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.814699+0000","last_change":"2024-09-14T07:13:09.814957+0000","last_active":"2024-09-14T07:13:09.814699+0000","last_peered":"2024-09-14T07:13:09.814699+0000","last_clean":"2024-09-14T07:13:09.814699+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:13:09.814699+0000","last_undegraded":"2024-09-14T07:13:09.814699+0000","last_fullsized":"2024-09-14T07:13:09.814699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:04.574267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001125785,"stat_sum":{"num_bytes":47099771,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":3287,"num_read_kb":29042,"num_write":281,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806064+0000","last_change":"2024-09-14T07:12:15.765297+0000","last_active":"2024-09-14T07:13:09.806064+0000","last_peered":"2024-09-14T07:13:09.806064+0000","last_clean":"2024-09-14T07:13:09.806064+0000","last_became_active":"2024-09-14T07:12:15.765018+0000","last_became_peered":"2024-09-14T07:12:15.765018+0000","last_unstale":"2024-09-14T07:13:09.806064+0000","last_undegraded":"2024-09-14T07:13:09.806064+0000","last_fullsized":"2024-09-14T07:13:09.806064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:02.766098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"78'283","reported_seq":1592,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:04.875604+0000","last_change":"2024-09-14T07:13:06.741658+0000","last_active":"2024-09-14T07:13:06.741658+0000","last_peered":"2024-09-14T07:13:04.875604+0000","last_clean":"2024-09-14T07:12:02.182931+0000","last_became_active":"2024-09-14T07:13:04.766609+0000","last_became_peered":"2024-09-14T07:13:04.766609+0000","last_unstale":"2024-09-14T07:13:04.875604+0000","last_undegraded":"2024-09-14T07:13:04.875604+0000","last_fullsized":"2024-09-14T07:13:04.749693+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076532499999999997,"stat_sum":{"num_bytes":23306342,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":1603,"num_read_kb":10858,"num_write":341,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T07:13:05.769977+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:13:05.769977+0000","last_peered":"2024-09-14T07:13:05.769977+0000","last_clean":"2024-09-14T07:13:05.769977+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:13:05.769977+0000","last_undegraded":"2024-09-14T07:13:05.769977+0000","last_fullsized":"2024-09-14T07:13:05.769977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.813827+0000","last_change":"2024-09-14T07:12:15.764696+0000","last_active":"2024-09-14T07:13:09.813827+0000","last_peered":"2024-09-14T07:13:09.813827+0000","last_clean":"2024-09-14T07:13:09.813827+0000","last_became_active":"2024-09-14T07:12:15.764436+0000","last_became_peered":"2024-09-14T07:12:15.764436+0000","last_unstale":"2024-09-14T07:13:09.813827+0000","last_undegraded":"2024-09-14T07:13:09.813827+0000","last_fullsized":"2024-09-14T07:13:09.813827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"86'403","reported_seq":2993,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.900747+0000","last_change":"2024-09-14T07:13:09.816955+0000","last_active":"2024-09-14T07:13:09.900747+0000","last_peered":"2024-09-14T07:13:09.900747+0000","last_clean":"2024-09-14T07:13:09.900747+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:13:09.900747+0000","last_undegraded":"2024-09-14T07:13:09.900747+0000","last_fullsized":"2024-09-14T07:13:09.900747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:41.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040893400000000001,"stat_sum":{"num_bytes":17434307,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":4476,"num_read_kb":17744,"num_write":483,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.9","version":"89'488","reported_seq":4147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.826091+0000","last_change":"2024-09-14T07:13:09.826091+0000","last_active":"2024-09-14T07:13:09.826091+0000","last_peered":"2024-09-14T07:13:09.826091+0000","last_clean":"2024-09-14T07:13:09.826091+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:13:09.826091+0000","last_undegraded":"2024-09-14T07:13:09.826091+0000","last_fullsized":"2024-09-14T07:13:09.826091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.166748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011056589999999999,"stat_sum":{"num_bytes":37954895,"num_objects":44,"num_object_clones":15,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":6344,"num_read_kb":37126,"num_write":478,"num_write_kb":19491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.a","version":"89'346","reported_seq":1993,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.882218+0000","last_change":"2024-09-14T07:13:09.881314+0000","last_active":"2024-09-14T07:13:09.882218+0000","last_peered":"2024-09-14T07:13:09.882218+0000","last_clean":"2024-09-14T07:13:09.882218+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:13:09.882218+0000","last_undegraded":"2024-09-14T07:13:09.882218+0000","last_fullsized":"2024-09-14T07:13:09.882218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:30.508428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200590000000001,"stat_sum":{"num_bytes":38995099,"num_objects":36,"num_object_clones":14,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":1918,"num_read_kb":55145,"num_write":401,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.b","version":"89'265","reported_seq":2520,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881358+0000","last_change":"2024-09-14T07:13:09.815243+0000","last_active":"2024-09-14T07:13:09.881358+0000","last_peered":"2024-09-14T07:13:09.881358+0000","last_clean":"2024-09-14T07:13:09.881358+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:13:09.881358+0000","last_undegraded":"2024-09-14T07:13:09.881358+0000","last_fullsized":"2024-09-14T07:13:09.881358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.502792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001405545,"stat_sum":{"num_bytes":72516826,"num_objects":36,"num_object_clones":13,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":2115,"num_read_kb":21709,"num_write":271,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.c","version":"84'655","reported_seq":5873,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770232+0000","last_change":"2024-09-14T07:13:05.770123+0000","last_active":"2024-09-14T07:13:05.770123+0000","last_peered":"2024-09-14T07:13:04.889961+0000","last_clean":"2024-09-14T07:12:02.167669+0000","last_became_active":"2024-09-14T07:13:04.771059+0000","last_became_peered":"2024-09-14T07:13:04.771059+0000","last_unstale":"2024-09-14T07:13:05.770232+0000","last_undegraded":"2024-09-14T07:13:05.770232+0000","last_fullsized":"2024-09-14T07:13:05.770232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081047900000000002,"stat_sum":{"num_bytes":65121506,"num_objects":45,"num_object_clones":15,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":14,"num_read":7770,"num_read_kb":25202,"num_write":912,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"81'537","reported_seq":6203,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.312805+0000","last_change":"2024-09-14T07:13:06.741711+0000","last_active":"2024-09-14T07:13:06.741711+0000","last_peered":"2024-09-14T07:13:05.312805+0000","last_clean":"2024-09-14T07:12:02.196725+0000","last_became_active":"2024-09-14T07:13:04.768025+0000","last_became_peered":"2024-09-14T07:13:04.768025+0000","last_unstale":"2024-09-14T07:13:05.312805+0000","last_undegraded":"2024-09-14T07:13:05.312805+0000","last_fullsized":"2024-09-14T07:13:04.749545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072059800000000003,"stat_sum":{"num_bytes":32745120,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":9038,"num_read_kb":24422,"num_write":567,"num_write_kb":3792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1812153,"num_keys_recovered":60,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'172","reported_seq":2236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825250+0000","last_change":"2024-09-14T07:13:09.825250+0000","last_active":"2024-09-14T07:13:09.825250+0000","last_peered":"2024-09-14T07:13:09.825250+0000","last_clean":"2024-09-14T07:13:09.825250+0000","last_became_active":"2024-09-14T07:12:15.765001+0000","last_became_peered":"2024-09-14T07:12:15.765001+0000","last_unstale":"2024-09-14T07:13:09.825250+0000","last_undegraded":"2024-09-14T07:13:09.825250+0000","last_fullsized":"2024-09-14T07:13:09.825250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:34.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069921600000000001,"stat_sum":{"num_bytes":35841588,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":8,"num_read":2332,"num_read_kb":24563,"num_write":158,"num_write_kb":11223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.f","version":"86'474","reported_seq":4416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825122+0000","last_change":"2024-09-14T07:13:09.825378+0000","last_active":"2024-09-14T07:13:09.825122+0000","last_peered":"2024-09-14T07:13:09.825122+0000","last_clean":"2024-09-14T07:13:09.825122+0000","last_became_active":"2024-09-14T07:12:15.764966+0000","last_became_peered":"2024-09-14T07:12:15.764966+0000","last_unstale":"2024-09-14T07:13:09.825122+0000","last_undegraded":"2024-09-14T07:13:09.825122+0000","last_fullsized":"2024-09-14T07:13:09.825122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:00.976097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074657200000000003,"stat_sum":{"num_bytes":55249549,"num_objects":49,"num_object_clones":18,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":5402,"num_read_kb":18736,"num_write":539,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.10","version":"89'570","reported_seq":2768,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881263+0000","last_change":"2024-09-14T07:13:09.881263+0000","last_active":"2024-09-14T07:13:09.881263+0000","last_peered":"2024-09-14T07:13:09.881263+0000","last_clean":"2024-09-14T07:13:09.881263+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:13:09.881263+0000","last_undegraded":"2024-09-14T07:13:09.881263+0000","last_fullsized":"2024-09-14T07:13:09.881263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:21.361259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010614579999999999,"stat_sum":{"num_bytes":20738004,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":4187,"num_read_kb":14723,"num_write":781,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.11","version":"88'247","reported_seq":2783,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.824697+0000","last_change":"2024-09-14T07:13:09.825071+0000","last_active":"2024-09-14T07:13:09.824697+0000","last_peered":"2024-09-14T07:13:09.824697+0000","last_clean":"2024-09-14T07:13:09.824697+0000","last_became_active":"2024-09-14T07:12:15.764948+0000","last_became_peered":"2024-09-14T07:12:15.764948+0000","last_unstale":"2024-09-14T07:13:09.824697+0000","last_undegraded":"2024-09-14T07:13:09.824697+0000","last_fullsized":"2024-09-14T07:13:09.824697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:54.370146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062055699999999999,"stat_sum":{"num_bytes":37444907,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":2705,"num_read_kb":42529,"num_write":257,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.12","version":"89'337","reported_seq":4533,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825010+0000","last_change":"2024-09-14T07:13:09.825010+0000","last_active":"2024-09-14T07:13:09.825010+0000","last_peered":"2024-09-14T07:13:09.825010+0000","last_clean":"2024-09-14T07:13:09.825010+0000","last_became_active":"2024-09-14T07:12:44.655369+0000","last_became_peered":"2024-09-14T07:12:44.655369+0000","last_unstale":"2024-09-14T07:13:09.825010+0000","last_undegraded":"2024-09-14T07:13:09.825010+0000","last_fullsized":"2024-09-14T07:13:09.825010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:45.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048107199999999998,"stat_sum":{"num_bytes":10540105,"num_objects":41,"num_object_clones":13,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":6091,"num_read_kb":8894,"num_write":326,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":1502781,"num_keys_recovered":35,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.13","version":"89'355","reported_seq":3185,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825586+0000","last_change":"2024-09-14T07:13:09.825586+0000","last_active":"2024-09-14T07:13:09.825586+0000","last_peered":"2024-09-14T07:13:09.825586+0000","last_clean":"2024-09-14T07:13:09.825586+0000","last_became_active":"2024-09-14T07:12:15.765178+0000","last_became_peered":"2024-09-14T07:12:15.765178+0000","last_unstale":"2024-09-14T07:13:09.825586+0000","last_undegraded":"2024-09-14T07:13:09.825586+0000","last_fullsized":"2024-09-14T07:13:09.825586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.531979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099369600000000008,"stat_sum":{"num_bytes":43849917,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":3359,"num_read_kb":18650,"num_write":377,"num_write_kb":6992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1155112656,"num_objects":1204,"num_object_clones":392,"num_object_copies":2408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1204,"num_whiteouts":379,"num_read":138194,"num_read_kb":749839,"num_write":16646,"num_write_kb":400846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":30104779,"num_keys_recovered":130,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":394330112,"data_stored":505548720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":13523,"ondisk_log_size":13523,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70012,"kb_used_data":42928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94301828,"statfs":{"total":96636764160,"available":96565071872,"internally_reserved":0,"allocated":43958272,"data_stored":52868686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56372,"kb_used_data":25172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315468,"statfs":{"total":96636764160,"available":96579039232,"internally_reserved":0,"allocated":25776128,"data_stored":33312892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318274,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95180,"kb_used_data":62584,"kb_used_omap":9,"kb_used_meta":32566,"kb_avail":94276660,"statfs":{"total":96636764160,"available":96539299840,"internally_reserved":0,"allocated":64086016,"data_stored":78374057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":33348232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142752,"kb_used_data":93464,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94229088,"statfs":{"total":96636764160,"available":96490586112,"internally_reserved":0,"allocated":95707136,"data_stored":113422218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110388,"kb_used_data":70876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94261452,"statfs":{"total":96636764160,"available":96523726848,"internally_reserved":0,"allocated":72577024,"data_stored":90190024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63920,"kb_used_data":28572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307920,"statfs":{"total":96636764160,"available":96571310080,"internally_reserved":0,"allocated":29257728,"data_stored":37037141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88368,"kb_used_data":48856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94283472,"statfs":{"total":96636764160,"available":96546275328,"internally_reserved":0,"allocated":50028544,"data_stored":67992386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105808,"kb_used_data":78776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94266032,"statfs":{"total":96636764160,"available":96528416768,"internally_reserved":0,"allocated":80666624,"data_stored":95559367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62947328,"data_stored":78415072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45772800,"data_stored":64301963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25026560,"data_stored":33368989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61673472,"data_stored":79867111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81747968,"data_stored":100032863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63082496,"data_stored":77911094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24690688,"data_stored":32785984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":38865644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:13:10.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-14T07:13:10.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:10.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:10.505 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:10.505 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:10.506 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:10.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:10.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:10.529 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:10.544 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:10.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:10.555 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:10.554+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:10.561 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:10.562 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:10.636 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:10.636 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:10.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:10.656 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:10.654+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:10.751 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 66.982869174000001, 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 66.981770284999996, 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:13:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.954927126000001, 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:13:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.941633121000002, 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:13:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:13:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.941563707, 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:13:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:13:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.101185682000001, 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:13:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:13:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:13:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.925594443999998, 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:13:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:13:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.635529548000001, 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:13:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.631501249999999, 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:13:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:13:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.410502127000001, 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:13:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:13:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:13:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.406984315999999, 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:13:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.936845336000001, 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:13:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.284481996, 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:13:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:13:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.945983555000002, 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:13:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.940335652000002, 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:13:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:13:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.202848969000001, 2024-09-14T07:13:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.974963068000001, 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:13:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.722266294000001, 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:13:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.680318684, 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.837 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:13:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(osd.4.0:3560 3.9 e87/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:22 v 87'485, mlcod=86'482)", 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9511960610000001, 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038721369999999999, 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798537+0000", 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7700000000000005e-07 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798543+0000", 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798553+0000", 2024-09-14T07:13:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.611e-06 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798562+0000", 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4210000000000001e-06 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798621+0000", 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9264e-05 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798642+0000", 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0996e-05 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802363+0000", 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037204899999999999 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802408+0000", 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5435999999999997e-05 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:10.846 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:10.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:13:10.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:10.848 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:10.846+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"nodeep-scrub flag(s) set","count":12},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":109,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":90,"num_osds":8,"num_up_osds":8,"osd_up_since":1726297982,"num_in_osds":8,"osd_in_since":1726297884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":34},{"state_name":"peering","count":7}],"num_pgs":41,"num_pools":3,"num_objects":1208,"data_bytes":1155703043,"bytes_used":750387200,"bytes_avail":772343726080,"bytes_total":773094113280,"inactive_pgs_ratio":0.17073170840740204,"recovering_objects_per_sec":47,"recovering_bytes_per_sec":5926282,"recovering_keys_per_sec":23,"num_objects_recovered":191,"num_bytes_recovered":23710263,"num_keys_recovered":95,"read_bytes_sec":171994,"write_bytes_sec":9981,"read_op_per_sec":196,"write_op_per_sec":38},"fsmap":{"epoch":1,"btime":"2024-09-14T07:11:21:841602+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-14T07:12:36.349873+0000","services":{}},"progress_events":{}} 2024-09-14T07:13:10.887 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-14T07:13:10.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:13:10.947 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:10.946+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:10.981 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:10.982 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:10.982 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:10.982 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:10.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:11.048 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:11.047+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:11.101 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:11.101 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:11.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:11.149 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:11.148+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245552015000001, 2024-09-14T07:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245519663000003, 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245435012000002, 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:13:11.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245409653000003, 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:13:11.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:13:11.234 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245376944999997, 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.235 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:13:11.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:13:11.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245344821000003, 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.240 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:13:11.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245313402999997, 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245289434, 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:13:11.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:13:11.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245269735999997, 2024-09-14T07:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:13:11.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:13:11.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:13:11.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245255794000002, 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:13:11.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245244563999997, 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:11.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245233435999999, 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.267 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245222274, 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:13:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:13:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245211562999998, 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245201856000001, 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:13:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:13:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245192291999999, 2024-09-14T07:13:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:13:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:13:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245182956000001, 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:13:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:13:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245172764000003, 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:13:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:13:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245152386999997, 2024-09-14T07:13:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:13:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.245106343000003, 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:13:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:11.308 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:11.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:11.311 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:13:11.312 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-14T07:13:10.814366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1155703043,"num_objects":1208,"num_object_clones":392,"num_object_copies":2416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":379,"num_read":138260,"num_read_kb":749894,"num_write":16749,"num_write_kb":402476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":30104779,"num_keys_recovered":130,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13598,"ondisk_log_size":13598,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":732800,"kb_used_data":451228,"kb_used_omap":20,"kb_used_meta":281259,"kb_avail":754241920,"statfs":{"total":773094113280,"available":772343726080,"internally_reserved":0,"allocated":462057472,"data_stored":568756771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":288009972},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-232689775,"num_objects":-73,"num_object_clones":-10,"num_object_copies":-146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-140,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-73,"num_whiteouts":-6,"num_read":793,"num_read_kb":675,"num_write":155,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":23355473,"num_keys_recovered":35,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.050160"},"pg_stats":[{"pgid":"3.1f","version":"89'522","reported_seq":4312,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815543+0000","last_change":"2024-09-14T07:13:09.815543+0000","last_active":"2024-09-14T07:13:09.815543+0000","last_peered":"2024-09-14T07:13:09.815543+0000","last_clean":"2024-09-14T07:13:09.815543+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:13:09.815543+0000","last_undegraded":"2024-09-14T07:13:09.815543+0000","last_fullsized":"2024-09-14T07:13:09.815543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:08.956266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011994530000000001,"stat_sum":{"num_bytes":28484678,"num_objects":49,"num_object_clones":20,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":20,"num_read":5858,"num_read_kb":30075,"num_write":669,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1e","version":"89'255","reported_seq":4169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.882320+0000","last_change":"2024-09-14T07:13:09.882320+0000","last_active":"2024-09-14T07:13:09.882320+0000","last_peered":"2024-09-14T07:13:09.882320+0000","last_clean":"2024-09-14T07:13:09.882320+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:13:09.882320+0000","last_undegraded":"2024-09-14T07:13:09.882320+0000","last_fullsized":"2024-09-14T07:13:09.882320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.961500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021217290000000001,"stat_sum":{"num_bytes":27760179,"num_objects":44,"num_object_clones":16,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":15,"num_read":3825,"num_read_kb":18605,"num_write":274,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1d","version":"84'216","reported_seq":1765,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.771457+0000","last_change":"2024-09-14T07:13:05.771350+0000","last_active":"2024-09-14T07:13:05.771350+0000","last_peered":"2024-09-14T07:13:04.768074+0000","last_clean":"2024-09-14T07:12:01.804976+0000","last_became_active":"2024-09-14T07:13:04.767267+0000","last_became_peered":"2024-09-14T07:13:04.767267+0000","last_unstale":"2024-09-14T07:13:05.771457+0000","last_undegraded":"2024-09-14T07:13:05.771457+0000","last_fullsized":"2024-09-14T07:13:05.771457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001026585,"stat_sum":{"num_bytes":18772275,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":1434,"num_read_kb":8956,"num_write":215,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"84'450","reported_seq":1849,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770904+0000","last_change":"2024-09-14T07:13:05.770782+0000","last_active":"2024-09-14T07:13:05.770782+0000","last_peered":"2024-09-14T07:13:04.886959+0000","last_clean":"2024-09-14T07:12:02.077164+0000","last_became_active":"2024-09-14T07:13:04.770636+0000","last_became_peered":"2024-09-14T07:13:04.770636+0000","last_unstale":"2024-09-14T07:13:05.770904+0000","last_undegraded":"2024-09-14T07:13:05.770904+0000","last_fullsized":"2024-09-14T07:13:05.770904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088611199999999999,"stat_sum":{"num_bytes":64233554,"num_objects":52,"num_object_clones":20,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":2373,"num_read_kb":13266,"num_write":545,"num_write_kb":7975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"89'239","reported_seq":2665,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815274+0000","last_change":"2024-09-14T07:13:09.815274+0000","last_active":"2024-09-14T07:13:09.815274+0000","last_peered":"2024-09-14T07:13:09.815274+0000","last_clean":"2024-09-14T07:13:09.815274+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:13:09.815274+0000","last_undegraded":"2024-09-14T07:13:09.815274+0000","last_fullsized":"2024-09-14T07:13:09.815274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:36.667442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011608580000000001,"stat_sum":{"num_bytes":15079695,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":2515,"num_read_kb":18862,"num_write":276,"num_write_kb":6318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1a","version":"84'641","reported_seq":3305,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.847756+0000","last_change":"2024-09-14T07:13:09.825841+0000","last_active":"2024-09-14T07:13:09.847756+0000","last_peered":"2024-09-14T07:13:09.847756+0000","last_clean":"2024-09-14T07:13:09.847756+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:13:09.847756+0000","last_undegraded":"2024-09-14T07:13:09.847756+0000","last_fullsized":"2024-09-14T07:13:09.847756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:22.508419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010313329999999999,"stat_sum":{"num_bytes":59168785,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":4748,"num_read_kb":27874,"num_write":986,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.19","version":"89'330","reported_seq":5005,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806727+0000","last_change":"2024-09-14T07:13:09.806727+0000","last_active":"2024-09-14T07:13:09.806727+0000","last_peered":"2024-09-14T07:13:09.806727+0000","last_clean":"2024-09-14T07:13:09.806727+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:13:09.806727+0000","last_undegraded":"2024-09-14T07:13:09.806727+0000","last_fullsized":"2024-09-14T07:13:09.806727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:47.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042086000000000001,"stat_sum":{"num_bytes":33962733,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":16,"num_read":5009,"num_read_kb":21132,"num_write":408,"num_write_kb":8863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.18","version":"89'401","reported_seq":2638,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.888069+0000","last_change":"2024-09-14T07:13:09.815020+0000","last_active":"2024-09-14T07:13:09.888069+0000","last_peered":"2024-09-14T07:13:09.888069+0000","last_clean":"2024-09-14T07:13:09.888069+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:13:09.888069+0000","last_undegraded":"2024-09-14T07:13:09.888069+0000","last_fullsized":"2024-09-14T07:13:09.888069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:33.132990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00120506,"stat_sum":{"num_bytes":31752725,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":3738,"num_read_kb":33182,"num_write":471,"num_write_kb":15663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.17","version":"89'640","reported_seq":7832,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815814+0000","last_change":"2024-09-14T07:13:09.815814+0000","last_active":"2024-09-14T07:13:09.815814+0000","last_peered":"2024-09-14T07:13:09.815814+0000","last_clean":"2024-09-14T07:13:09.815814+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:13:09.815814+0000","last_undegraded":"2024-09-14T07:13:09.815814+0000","last_fullsized":"2024-09-14T07:13:09.815814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:56.390045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014065480000000001,"stat_sum":{"num_bytes":29239636,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":7,"num_read":9651,"num_read_kb":40623,"num_write":824,"num_write_kb":14498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.16","version":"84'434","reported_seq":2229,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770611+0000","last_change":"2024-09-14T07:13:05.770139+0000","last_active":"2024-09-14T07:13:05.770139+0000","last_peered":"2024-09-14T07:13:04.831258+0000","last_clean":"2024-09-14T07:12:02.114005+0000","last_became_active":"2024-09-14T07:13:04.766946+0000","last_became_peered":"2024-09-14T07:13:04.766946+0000","last_unstale":"2024-09-14T07:13:05.770611+0000","last_undegraded":"2024-09-14T07:13:05.770611+0000","last_fullsized":"2024-09-14T07:13:05.770611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106477,"stat_sum":{"num_bytes":22919358,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":3185,"num_read_kb":8586,"num_write":580,"num_write_kb":4095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'303","reported_seq":1119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.817193+0000","last_change":"2024-09-14T07:13:09.817193+0000","last_active":"2024-09-14T07:13:09.817193+0000","last_peered":"2024-09-14T07:13:09.817193+0000","last_clean":"2024-09-14T07:13:09.817193+0000","last_became_active":"2024-09-14T07:12:15.764942+0000","last_became_peered":"2024-09-14T07:12:15.764942+0000","last_unstale":"2024-09-14T07:13:09.817193+0000","last_undegraded":"2024-09-14T07:13:09.817193+0000","last_fullsized":"2024-09-14T07:13:09.817193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:57.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044608799999999997,"stat_sum":{"num_bytes":25099279,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1323,"num_read_kb":15086,"num_write":371,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.14","version":"89'708","reported_seq":3516,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825883+0000","last_change":"2024-09-14T07:13:09.825883+0000","last_active":"2024-09-14T07:13:09.825883+0000","last_peered":"2024-09-14T07:13:09.825883+0000","last_clean":"2024-09-14T07:13:09.825883+0000","last_became_active":"2024-09-14T07:11:51.642949+0000","last_became_peered":"2024-09-14T07:11:51.642949+0000","last_unstale":"2024-09-14T07:13:09.825883+0000","last_undegraded":"2024-09-14T07:13:09.825883+0000","last_fullsized":"2024-09-14T07:13:09.825883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:47:05.664837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010494320000000001,"stat_sum":{"num_bytes":29508843,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":5406,"num_read_kb":29493,"num_write":1109,"num_write_kb":9275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.880136+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:13:09.880136+0000","last_peered":"2024-09-14T07:13:09.880136+0000","last_clean":"2024-09-14T07:13:09.880136+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:13:09.880136+0000","last_undegraded":"2024-09-14T07:13:09.880136+0000","last_fullsized":"2024-09-14T07:13:09.880136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"89'762","reported_seq":3990,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815632+0000","last_change":"2024-09-14T07:13:09.815632+0000","last_active":"2024-09-14T07:13:09.815632+0000","last_peered":"2024-09-14T07:13:09.815632+0000","last_clean":"2024-09-14T07:13:09.815632+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:13:09.815632+0000","last_undegraded":"2024-09-14T07:13:09.815632+0000","last_fullsized":"2024-09-14T07:13:09.815632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.528280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014962790000000001,"stat_sum":{"num_bytes":46216749,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":6819,"num_read_kb":29133,"num_write":921,"num_write_kb":10652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806158+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:13:09.806158+0000","last_peered":"2024-09-14T07:13:09.806158+0000","last_clean":"2024-09-14T07:13:09.806158+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:13:09.806158+0000","last_undegraded":"2024-09-14T07:13:09.806158+0000","last_fullsized":"2024-09-14T07:13:09.806158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"89'311","reported_seq":4557,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.816658+0000","last_change":"2024-09-14T07:13:09.816658+0000","last_active":"2024-09-14T07:13:09.816658+0000","last_peered":"2024-09-14T07:13:09.816658+0000","last_clean":"2024-09-14T07:13:09.816658+0000","last_became_active":"2024-09-14T07:11:51.646069+0000","last_became_peered":"2024-09-14T07:11:51.646069+0000","last_unstale":"2024-09-14T07:13:09.816658+0000","last_undegraded":"2024-09-14T07:13:09.816658+0000","last_fullsized":"2024-09-14T07:13:09.816658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:38.258049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673999999999999,"stat_sum":{"num_bytes":19823261,"num_objects":34,"num_object_clones":14,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":5417,"num_read_kb":21582,"num_write":306,"num_write_kb":6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.813898+0000","last_change":"2024-09-14T07:12:15.765521+0000","last_active":"2024-09-14T07:13:09.813898+0000","last_peered":"2024-09-14T07:13:09.813898+0000","last_clean":"2024-09-14T07:13:09.813898+0000","last_became_active":"2024-09-14T07:12:15.765216+0000","last_became_peered":"2024-09-14T07:12:15.765216+0000","last_unstale":"2024-09-14T07:13:09.813898+0000","last_undegraded":"2024-09-14T07:13:09.813898+0000","last_fullsized":"2024-09-14T07:13:09.813898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.152750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'867","reported_seq":4536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806841+0000","last_change":"2024-09-14T07:13:09.806841+0000","last_active":"2024-09-14T07:13:09.806841+0000","last_peered":"2024-09-14T07:13:09.806841+0000","last_clean":"2024-09-14T07:13:09.806841+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:13:09.806841+0000","last_undegraded":"2024-09-14T07:13:09.806841+0000","last_fullsized":"2024-09-14T07:13:09.806841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:16.413345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043783899999999998,"stat_sum":{"num_bytes":32910285,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":11,"num_read":8187,"num_read_kb":22512,"num_write":1196,"num_write_kb":11165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806665+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:13:09.806665+0000","last_peered":"2024-09-14T07:13:09.806665+0000","last_clean":"2024-09-14T07:13:09.806665+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:13:09.806665+0000","last_undegraded":"2024-09-14T07:13:09.806665+0000","last_fullsized":"2024-09-14T07:13:09.806665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'500","reported_seq":1110,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770618+0000","last_change":"2024-09-14T07:13:05.770618+0000","last_active":"2024-09-14T07:13:03.752449+0000","last_peered":"2024-09-14T07:13:01.746230+0000","last_clean":"2024-09-14T07:12:02.196630+0000","last_became_active":"2024-09-14T07:12:03.695737+0000","last_became_peered":"2024-09-14T07:12:03.695737+0000","last_unstale":"2024-09-14T07:13:05.770618+0000","last_undegraded":"2024-09-14T07:13:05.770618+0000","last_fullsized":"2024-09-14T07:13:05.770618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094557899999999999,"stat_sum":{"num_bytes":25621307,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":1963,"num_read_kb":11504,"num_write":698,"num_write_kb":14788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'319","reported_seq":2435,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881703+0000","last_change":"2024-09-14T07:13:09.825590+0000","last_active":"2024-09-14T07:13:09.881703+0000","last_peered":"2024-09-14T07:13:09.881703+0000","last_clean":"2024-09-14T07:13:09.881703+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:13:09.881703+0000","last_undegraded":"2024-09-14T07:13:09.881703+0000","last_fullsized":"2024-09-14T07:13:09.881703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:20.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095568200000000002,"stat_sum":{"num_bytes":50647894,"num_objects":38,"num_object_clones":13,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":2127,"num_read_kb":22236,"num_write":398,"num_write_kb":19006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.2","version":"22'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T07:13:05.769164+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:13:05.769164+0000","last_peered":"2024-09-14T07:13:05.769164+0000","last_clean":"2024-09-14T07:13:05.769164+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:13:05.769164+0000","last_undegraded":"2024-09-14T07:13:05.769164+0000","last_fullsized":"2024-09-14T07:13:05.769164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'239","reported_seq":4050,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806526+0000","last_change":"2024-09-14T07:13:09.806526+0000","last_active":"2024-09-14T07:13:09.806526+0000","last_peered":"2024-09-14T07:13:09.806526+0000","last_clean":"2024-09-14T07:13:09.806526+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:13:09.806526+0000","last_undegraded":"2024-09-14T07:13:09.806526+0000","last_fullsized":"2024-09-14T07:13:09.806526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:12.384277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047440200000000002,"stat_sum":{"num_bytes":55073484,"num_objects":38,"num_object_clones":14,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":3989,"num_read_kb":27789,"num_write":227,"num_write_kb":9458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.805897+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:13:09.805897+0000","last_peered":"2024-09-14T07:13:09.805897+0000","last_clean":"2024-09-14T07:13:09.805897+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:13:09.805897+0000","last_undegraded":"2024-09-14T07:13:09.805897+0000","last_fullsized":"2024-09-14T07:13:09.805897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'254","reported_seq":3227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.814699+0000","last_change":"2024-09-14T07:13:09.814957+0000","last_active":"2024-09-14T07:13:09.814699+0000","last_peered":"2024-09-14T07:13:09.814699+0000","last_clean":"2024-09-14T07:13:09.814699+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:13:09.814699+0000","last_undegraded":"2024-09-14T07:13:09.814699+0000","last_fullsized":"2024-09-14T07:13:09.814699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:04.574267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001125785,"stat_sum":{"num_bytes":47099771,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":3287,"num_read_kb":29042,"num_write":281,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806064+0000","last_change":"2024-09-14T07:12:15.765297+0000","last_active":"2024-09-14T07:13:09.806064+0000","last_peered":"2024-09-14T07:13:09.806064+0000","last_clean":"2024-09-14T07:13:09.806064+0000","last_became_active":"2024-09-14T07:12:15.765018+0000","last_became_peered":"2024-09-14T07:12:15.765018+0000","last_unstale":"2024-09-14T07:13:09.806064+0000","last_undegraded":"2024-09-14T07:13:09.806064+0000","last_fullsized":"2024-09-14T07:13:09.806064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:02.766098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"78'283","reported_seq":1592,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:04.875604+0000","last_change":"2024-09-14T07:13:06.741658+0000","last_active":"2024-09-14T07:13:06.741658+0000","last_peered":"2024-09-14T07:13:04.875604+0000","last_clean":"2024-09-14T07:12:02.182931+0000","last_became_active":"2024-09-14T07:13:04.766609+0000","last_became_peered":"2024-09-14T07:13:04.766609+0000","last_unstale":"2024-09-14T07:13:04.875604+0000","last_undegraded":"2024-09-14T07:13:04.875604+0000","last_fullsized":"2024-09-14T07:13:04.749693+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076532499999999997,"stat_sum":{"num_bytes":23306342,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":1603,"num_read_kb":10858,"num_write":341,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T07:13:05.769977+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:13:05.769977+0000","last_peered":"2024-09-14T07:13:05.769977+0000","last_clean":"2024-09-14T07:13:05.769977+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:13:05.769977+0000","last_undegraded":"2024-09-14T07:13:05.769977+0000","last_fullsized":"2024-09-14T07:13:05.769977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.813827+0000","last_change":"2024-09-14T07:12:15.764696+0000","last_active":"2024-09-14T07:13:09.813827+0000","last_peered":"2024-09-14T07:13:09.813827+0000","last_clean":"2024-09-14T07:13:09.813827+0000","last_became_active":"2024-09-14T07:12:15.764436+0000","last_became_peered":"2024-09-14T07:12:15.764436+0000","last_unstale":"2024-09-14T07:13:09.813827+0000","last_undegraded":"2024-09-14T07:13:09.813827+0000","last_fullsized":"2024-09-14T07:13:09.813827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"86'403","reported_seq":2993,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.900747+0000","last_change":"2024-09-14T07:13:09.816955+0000","last_active":"2024-09-14T07:13:09.900747+0000","last_peered":"2024-09-14T07:13:09.900747+0000","last_clean":"2024-09-14T07:13:09.900747+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:13:09.900747+0000","last_undegraded":"2024-09-14T07:13:09.900747+0000","last_fullsized":"2024-09-14T07:13:09.900747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:41.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040893400000000001,"stat_sum":{"num_bytes":17434307,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":4476,"num_read_kb":17744,"num_write":483,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.9","version":"89'488","reported_seq":4147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.826091+0000","last_change":"2024-09-14T07:13:09.826091+0000","last_active":"2024-09-14T07:13:09.826091+0000","last_peered":"2024-09-14T07:13:09.826091+0000","last_clean":"2024-09-14T07:13:09.826091+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:13:09.826091+0000","last_undegraded":"2024-09-14T07:13:09.826091+0000","last_fullsized":"2024-09-14T07:13:09.826091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.166748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011056589999999999,"stat_sum":{"num_bytes":37954895,"num_objects":44,"num_object_clones":15,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":6344,"num_read_kb":37126,"num_write":478,"num_write_kb":19491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.a","version":"89'346","reported_seq":1993,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.882218+0000","last_change":"2024-09-14T07:13:09.881314+0000","last_active":"2024-09-14T07:13:09.882218+0000","last_peered":"2024-09-14T07:13:09.882218+0000","last_clean":"2024-09-14T07:13:09.882218+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:13:09.882218+0000","last_undegraded":"2024-09-14T07:13:09.882218+0000","last_fullsized":"2024-09-14T07:13:09.882218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:30.508428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200590000000001,"stat_sum":{"num_bytes":38995099,"num_objects":36,"num_object_clones":14,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":1918,"num_read_kb":55145,"num_write":401,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.b","version":"89'265","reported_seq":2520,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881358+0000","last_change":"2024-09-14T07:13:09.815243+0000","last_active":"2024-09-14T07:13:09.881358+0000","last_peered":"2024-09-14T07:13:09.881358+0000","last_clean":"2024-09-14T07:13:09.881358+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:13:09.881358+0000","last_undegraded":"2024-09-14T07:13:09.881358+0000","last_fullsized":"2024-09-14T07:13:09.881358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.502792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001405545,"stat_sum":{"num_bytes":72516826,"num_objects":36,"num_object_clones":13,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":2115,"num_read_kb":21709,"num_write":271,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.c","version":"84'655","reported_seq":5873,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.770232+0000","last_change":"2024-09-14T07:13:05.770123+0000","last_active":"2024-09-14T07:13:05.770123+0000","last_peered":"2024-09-14T07:13:04.889961+0000","last_clean":"2024-09-14T07:12:02.167669+0000","last_became_active":"2024-09-14T07:13:04.771059+0000","last_became_peered":"2024-09-14T07:13:04.771059+0000","last_unstale":"2024-09-14T07:13:05.770232+0000","last_undegraded":"2024-09-14T07:13:05.770232+0000","last_fullsized":"2024-09-14T07:13:05.770232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081047900000000002,"stat_sum":{"num_bytes":65121506,"num_objects":45,"num_object_clones":15,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":14,"num_read":7770,"num_read_kb":25202,"num_write":912,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"81'537","reported_seq":6203,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-14T07:13:05.312805+0000","last_change":"2024-09-14T07:13:06.741711+0000","last_active":"2024-09-14T07:13:06.741711+0000","last_peered":"2024-09-14T07:13:05.312805+0000","last_clean":"2024-09-14T07:12:02.196725+0000","last_became_active":"2024-09-14T07:13:04.768025+0000","last_became_peered":"2024-09-14T07:13:04.768025+0000","last_unstale":"2024-09-14T07:13:05.312805+0000","last_undegraded":"2024-09-14T07:13:05.312805+0000","last_fullsized":"2024-09-14T07:13:04.749545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072059800000000003,"stat_sum":{"num_bytes":32745120,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":9038,"num_read_kb":24422,"num_write":567,"num_write_kb":3792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1812153,"num_keys_recovered":60,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'172","reported_seq":2236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825250+0000","last_change":"2024-09-14T07:13:09.825250+0000","last_active":"2024-09-14T07:13:09.825250+0000","last_peered":"2024-09-14T07:13:09.825250+0000","last_clean":"2024-09-14T07:13:09.825250+0000","last_became_active":"2024-09-14T07:12:15.765001+0000","last_became_peered":"2024-09-14T07:12:15.765001+0000","last_unstale":"2024-09-14T07:13:09.825250+0000","last_undegraded":"2024-09-14T07:13:09.825250+0000","last_fullsized":"2024-09-14T07:13:09.825250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:34.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069921600000000001,"stat_sum":{"num_bytes":35841588,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":8,"num_read":2332,"num_read_kb":24563,"num_write":158,"num_write_kb":11223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.f","version":"86'474","reported_seq":4416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825122+0000","last_change":"2024-09-14T07:13:09.825378+0000","last_active":"2024-09-14T07:13:09.825122+0000","last_peered":"2024-09-14T07:13:09.825122+0000","last_clean":"2024-09-14T07:13:09.825122+0000","last_became_active":"2024-09-14T07:12:15.764966+0000","last_became_peered":"2024-09-14T07:12:15.764966+0000","last_unstale":"2024-09-14T07:13:09.825122+0000","last_undegraded":"2024-09-14T07:13:09.825122+0000","last_fullsized":"2024-09-14T07:13:09.825122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:00.976097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074657200000000003,"stat_sum":{"num_bytes":55249549,"num_objects":49,"num_object_clones":18,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":5402,"num_read_kb":18736,"num_write":539,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.10","version":"89'570","reported_seq":2768,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881263+0000","last_change":"2024-09-14T07:13:09.881263+0000","last_active":"2024-09-14T07:13:09.881263+0000","last_peered":"2024-09-14T07:13:09.881263+0000","last_clean":"2024-09-14T07:13:09.881263+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:13:09.881263+0000","last_undegraded":"2024-09-14T07:13:09.881263+0000","last_fullsized":"2024-09-14T07:13:09.881263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:21.361259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010614579999999999,"stat_sum":{"num_bytes":20738004,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":4187,"num_read_kb":14723,"num_write":781,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.11","version":"88'247","reported_seq":2783,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.824697+0000","last_change":"2024-09-14T07:13:09.825071+0000","last_active":"2024-09-14T07:13:09.824697+0000","last_peered":"2024-09-14T07:13:09.824697+0000","last_clean":"2024-09-14T07:13:09.824697+0000","last_became_active":"2024-09-14T07:12:15.764948+0000","last_became_peered":"2024-09-14T07:12:15.764948+0000","last_unstale":"2024-09-14T07:13:09.824697+0000","last_undegraded":"2024-09-14T07:13:09.824697+0000","last_fullsized":"2024-09-14T07:13:09.824697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:54.370146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062055699999999999,"stat_sum":{"num_bytes":37444907,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":2705,"num_read_kb":42529,"num_write":257,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.12","version":"89'337","reported_seq":4533,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825010+0000","last_change":"2024-09-14T07:13:09.825010+0000","last_active":"2024-09-14T07:13:09.825010+0000","last_peered":"2024-09-14T07:13:09.825010+0000","last_clean":"2024-09-14T07:13:09.825010+0000","last_became_active":"2024-09-14T07:12:44.655369+0000","last_became_peered":"2024-09-14T07:12:44.655369+0000","last_unstale":"2024-09-14T07:13:09.825010+0000","last_undegraded":"2024-09-14T07:13:09.825010+0000","last_fullsized":"2024-09-14T07:13:09.825010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:45.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048107199999999998,"stat_sum":{"num_bytes":10540105,"num_objects":41,"num_object_clones":13,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":6091,"num_read_kb":8894,"num_write":326,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":1502781,"num_keys_recovered":35,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.13","version":"89'355","reported_seq":3185,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825586+0000","last_change":"2024-09-14T07:13:09.825586+0000","last_active":"2024-09-14T07:13:09.825586+0000","last_peered":"2024-09-14T07:13:09.825586+0000","last_clean":"2024-09-14T07:13:09.825586+0000","last_became_active":"2024-09-14T07:12:15.765178+0000","last_became_peered":"2024-09-14T07:12:15.765178+0000","last_unstale":"2024-09-14T07:13:09.825586+0000","last_undegraded":"2024-09-14T07:13:09.825586+0000","last_fullsized":"2024-09-14T07:13:09.825586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.531979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099369600000000008,"stat_sum":{"num_bytes":43849917,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":3359,"num_read_kb":18650,"num_write":377,"num_write_kb":6992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1155112656,"num_objects":1204,"num_object_clones":392,"num_object_copies":2408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1204,"num_whiteouts":379,"num_read":138194,"num_read_kb":749839,"num_write":16646,"num_write_kb":400846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":30104779,"num_keys_recovered":130,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":394330112,"data_stored":505548720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":13523,"ondisk_log_size":13523,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70012,"kb_used_data":42928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94301828,"statfs":{"total":96636764160,"available":96565071872,"internally_reserved":0,"allocated":43958272,"data_stored":52868686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56372,"kb_used_data":25172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315468,"statfs":{"total":96636764160,"available":96579039232,"internally_reserved":0,"allocated":25776128,"data_stored":33312892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318274,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95180,"kb_used_data":62584,"kb_used_omap":9,"kb_used_meta":32566,"kb_avail":94276660,"statfs":{"total":96636764160,"available":96539299840,"internally_reserved":0,"allocated":64086016,"data_stored":78374057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":33348232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142752,"kb_used_data":93464,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94229088,"statfs":{"total":96636764160,"available":96490586112,"internally_reserved":0,"allocated":95707136,"data_stored":113422218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110388,"kb_used_data":70876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94261452,"statfs":{"total":96636764160,"available":96523726848,"internally_reserved":0,"allocated":72577024,"data_stored":90190024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63920,"kb_used_data":28572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307920,"statfs":{"total":96636764160,"available":96571310080,"internally_reserved":0,"allocated":29257728,"data_stored":37037141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88368,"kb_used_data":48856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94283472,"statfs":{"total":96636764160,"available":96546275328,"internally_reserved":0,"allocated":50028544,"data_stored":67992386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105808,"kb_used_data":78776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94266032,"statfs":{"total":96636764160,"available":96528416768,"internally_reserved":0,"allocated":80666624,"data_stored":95559367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62947328,"data_stored":78415072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45772800,"data_stored":64301963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25026560,"data_stored":33368989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61673472,"data_stored":79867111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81747968,"data_stored":100032863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":63082496,"data_stored":77911094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24690688,"data_stored":32785984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":38865644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:13:11.314 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:11.308+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:11.410 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:11.409+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:11.418 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:11.418 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:11.418 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:11.418 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:11.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:11.511 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:11.509+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:11.530 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:11.531 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:11.531 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:11.531 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:11.531 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:11.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:11.624 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:11.622+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.339030031, 2024-09-14T07:13:11.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:13:11.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.339019581999999, 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.691 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:11.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.339009629, 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.338998705000002, 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.700 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:13:11.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:13:11.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.338988462, 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.705 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:11.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:13:11.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:13:11.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.333042895999998, 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:13:11.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:13:11.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.713 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.333021761000001, 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.333000266999999, 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:11.722 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332977239000002, 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:13:11.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332955863999999, 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:13:11.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:13:11.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332944445999999, 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:11.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:13:11.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332929844999999, 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332918777, 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332907917, 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:13:11.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332895898, 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:11.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.753 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332886075000001, 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.757 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332871347000001, 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:13:11.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:11.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.762 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332861219000002, 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.766 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.332851665, 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:13:11.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.679082188999999, 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:11.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:13:11.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:13:11.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:11.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:11.777 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:11.779 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:11.779 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:11.776+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:11.821 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:13:11.885 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:11.884+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:11.940 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:11.940 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:11.940 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:11.940 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:11.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:11.980 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:11.979+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:12.054 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:12.054 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:12.054 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:12.054 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:12.054 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:12.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:12.081 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:12.080+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:12.167 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.308880029000001, 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:12.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352409858000001, 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.178 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352399538, 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352380562, 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:12.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:12.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:12.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352369136999997, 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.188 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.192 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352357640999998, 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:12.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352346592000004, 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:12.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352336276999999, 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.202 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:12.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.352297024000002, 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.346402073999997, 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:12.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:12.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.346391308000001, 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.215 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:12.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.346381049000001, 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:12.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.346370342999997, 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:12.225 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:12.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.346356575999998, 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:12.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:12.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.346346105999999, 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.238 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.340390947000003, 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:12.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:12.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.340380574999998, 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.243 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:12.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:12.247 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.340369647999999, 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:12.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.340360093000001, 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.252 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.022407400999999, 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:12.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.262 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:12.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:12.264 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:12.262+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:12.364 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:12.363+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:12.366 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:12.366 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:12.366 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:12.366 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:12.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:12.466 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:12.465+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:12.518 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:12.518 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:12.518 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:12.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:12.570 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:12.568+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:12.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:12.629 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:12.632 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:12.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:12.632 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:12.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.632 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:12.632 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 94.493077084999996, 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.633 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:12.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:12.634 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:12.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.634 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:12.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:12.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:12.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:12.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:12.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:12.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:12.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.937760562999998, 2024-09-14T07:13:12.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:12.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:12.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:12.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:12.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:12.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:12.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:12.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:12.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:12.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717487665999997, 2024-09-14T07:13:12.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:12.661 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717465975000003, 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.662 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:12.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717446072000001, 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.668 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:12.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:12.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717424577999999, 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:12.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:12.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.678 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717406257, 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717379913999999, 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:12.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:12.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717359449, 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.689 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:12.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:12.694 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717337594, 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:12.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.700 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717318958999996, 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.701 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:12.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:12.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717292817999997, 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:12.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:12.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:12.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:12.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:12.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.711 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717265300000001, 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.712 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717247821000001, 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.723 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.717235705, 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:12.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:12.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.711793686999997, 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:12.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:12.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.711774363000004, 2024-09-14T07:13:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.711745512999997, 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:12.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.711704988999998, 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.744 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:12.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.711682963999998, 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:12.748 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:12.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:12.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:12.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:12.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:12.753 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:12.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:12.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:12.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:12.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:12.756 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:12.753+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:12.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:12.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:12.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:12.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:12.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:12.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:12.787 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:12.787 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:12.803 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:12.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:12.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:12.854 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:12.853+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:12.907 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:12.907 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:12.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:12.955 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:12.955+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:13.057 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:13.055+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:13.061 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.061 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:13.158 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:13.156+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:13.172 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.172 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:13.260 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:13.259+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:13.284 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.284 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:13.361 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:13.360+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:13.436 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.437 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:13.489 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:13.488+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:13.548 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.548 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:13.598 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:13.597+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:13.664 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:13.663+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:13.700 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.700 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:13.793 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:13.792+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:13.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:13:13.862 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:13.863 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:13.869 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:13.867+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:13.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:13.970 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:13.969+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:14.025 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.025 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:14.071 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:14.070+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:14.172 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:14.171+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:14.177 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.177 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:14.272 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:14.271+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:14.288 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.288 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:14.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:13:14.373 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:14.372+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:14.402 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.402 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:14.474 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:14.473+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:14.518 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.518 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:14.574 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:14.573+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:13:14.647 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-14T07:13:14.358171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1143273364,"num_objects":1196,"num_object_clones":391,"num_object_copies":2392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":378,"num_read":138922,"num_read_kb":750461,"num_write":16814,"num_write_kb":402493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":658,"num_bytes_recovered":54938983,"num_keys_recovered":220,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13668,"ondisk_log_size":13668,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":720344,"kb_used_data":438768,"kb_used_omap":20,"kb_used_meta":281259,"kb_avail":754254376,"statfs":{"total":773094113280,"available":772356481024,"internally_reserved":0,"allocated":449298432,"data_stored":556039022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":288009972},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12429679,"num_objects":-12,"num_object_clones":-1,"num_object_copies":-24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":-1,"num_read":662,"num_read_kb":567,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":319,"num_bytes_recovered":24834204,"num_keys_recovered":90,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000933"},"pg_stats":[{"pgid":"3.1f","version":"89'522","reported_seq":4312,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815543+0000","last_change":"2024-09-14T07:13:09.815543+0000","last_active":"2024-09-14T07:13:09.815543+0000","last_peered":"2024-09-14T07:13:09.815543+0000","last_clean":"2024-09-14T07:13:09.815543+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:13:09.815543+0000","last_undegraded":"2024-09-14T07:13:09.815543+0000","last_fullsized":"2024-09-14T07:13:09.815543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:08.956266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011994530000000001,"stat_sum":{"num_bytes":28484678,"num_objects":49,"num_object_clones":20,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":20,"num_read":5858,"num_read_kb":30075,"num_write":669,"num_write_kb":17793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1e","version":"89'255","reported_seq":4169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.882320+0000","last_change":"2024-09-14T07:13:09.882320+0000","last_active":"2024-09-14T07:13:09.882320+0000","last_peered":"2024-09-14T07:13:09.882320+0000","last_clean":"2024-09-14T07:13:09.882320+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:13:09.882320+0000","last_undegraded":"2024-09-14T07:13:09.882320+0000","last_fullsized":"2024-09-14T07:13:09.882320+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.961500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021217290000000001,"stat_sum":{"num_bytes":27760179,"num_objects":44,"num_object_clones":16,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":15,"num_read":3825,"num_read_kb":18605,"num_write":274,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1d","version":"84'216","reported_seq":1822,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.819564+0000","last_change":"2024-09-14T07:13:10.820100+0000","last_active":"2024-09-14T07:13:10.819564+0000","last_peered":"2024-09-14T07:13:10.819564+0000","last_clean":"2024-09-14T07:13:10.819564+0000","last_became_active":"2024-09-14T07:13:06.768474+0000","last_became_peered":"2024-09-14T07:13:06.768474+0000","last_unstale":"2024-09-14T07:13:10.819564+0000","last_undegraded":"2024-09-14T07:13:10.819564+0000","last_fullsized":"2024-09-14T07:13:10.819564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:15.322776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013566310000000001,"stat_sum":{"num_bytes":18772275,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":1434,"num_read_kb":8956,"num_write":215,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":3213388,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"3.1c","version":"90'467","reported_seq":1956,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.938716+0000","last_change":"2024-09-14T07:13:10.819534+0000","last_active":"2024-09-14T07:13:10.938716+0000","last_peered":"2024-09-14T07:13:10.938716+0000","last_clean":"2024-09-14T07:13:10.938716+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:13:10.938716+0000","last_undegraded":"2024-09-14T07:13:10.938716+0000","last_fullsized":"2024-09-14T07:13:10.938716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:14:06.305667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000836589,"stat_sum":{"num_bytes":63814969,"num_objects":49,"num_object_clones":19,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":2440,"num_read_kb":13327,"num_write":567,"num_write_kb":7979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"3.1b","version":"89'239","reported_seq":2665,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815274+0000","last_change":"2024-09-14T07:13:09.815274+0000","last_active":"2024-09-14T07:13:09.815274+0000","last_peered":"2024-09-14T07:13:09.815274+0000","last_clean":"2024-09-14T07:13:09.815274+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:13:09.815274+0000","last_undegraded":"2024-09-14T07:13:09.815274+0000","last_fullsized":"2024-09-14T07:13:09.815274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:36.667442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011608580000000001,"stat_sum":{"num_bytes":15079695,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":2515,"num_read_kb":18862,"num_write":276,"num_write_kb":6318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.1a","version":"84'641","reported_seq":3305,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.847756+0000","last_change":"2024-09-14T07:13:09.825841+0000","last_active":"2024-09-14T07:13:09.847756+0000","last_peered":"2024-09-14T07:13:09.847756+0000","last_clean":"2024-09-14T07:13:09.847756+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:13:09.847756+0000","last_undegraded":"2024-09-14T07:13:09.847756+0000","last_fullsized":"2024-09-14T07:13:09.847756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:22.508419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010313329999999999,"stat_sum":{"num_bytes":59168785,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":4748,"num_read_kb":27874,"num_write":986,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.19","version":"89'330","reported_seq":5005,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806727+0000","last_change":"2024-09-14T07:13:09.806727+0000","last_active":"2024-09-14T07:13:09.806727+0000","last_peered":"2024-09-14T07:13:09.806727+0000","last_clean":"2024-09-14T07:13:09.806727+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:13:09.806727+0000","last_undegraded":"2024-09-14T07:13:09.806727+0000","last_fullsized":"2024-09-14T07:13:09.806727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:47.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042086000000000001,"stat_sum":{"num_bytes":33962733,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":16,"num_read":5009,"num_read_kb":21132,"num_write":408,"num_write_kb":8863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.18","version":"89'401","reported_seq":2638,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.888069+0000","last_change":"2024-09-14T07:13:09.815020+0000","last_active":"2024-09-14T07:13:09.888069+0000","last_peered":"2024-09-14T07:13:09.888069+0000","last_clean":"2024-09-14T07:13:09.888069+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:13:09.888069+0000","last_undegraded":"2024-09-14T07:13:09.888069+0000","last_fullsized":"2024-09-14T07:13:09.888069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:33.132990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00120506,"stat_sum":{"num_bytes":31752725,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":3738,"num_read_kb":33182,"num_write":471,"num_write_kb":15663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.17","version":"89'640","reported_seq":7832,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815814+0000","last_change":"2024-09-14T07:13:09.815814+0000","last_active":"2024-09-14T07:13:09.815814+0000","last_peered":"2024-09-14T07:13:09.815814+0000","last_clean":"2024-09-14T07:13:09.815814+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:13:09.815814+0000","last_undegraded":"2024-09-14T07:13:09.815814+0000","last_fullsized":"2024-09-14T07:13:09.815814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:56.390045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014065480000000001,"stat_sum":{"num_bytes":29239636,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":7,"num_read":9651,"num_read_kb":40623,"num_write":824,"num_write_kb":14498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.16","version":"84'434","reported_seq":2286,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.820160+0000","last_change":"2024-09-14T07:13:10.820828+0000","last_active":"2024-09-14T07:13:10.820160+0000","last_peered":"2024-09-14T07:13:10.820160+0000","last_clean":"2024-09-14T07:13:10.820160+0000","last_became_active":"2024-09-14T07:13:06.770063+0000","last_became_peered":"2024-09-14T07:13:06.770063+0000","last_unstale":"2024-09-14T07:13:10.820160+0000","last_undegraded":"2024-09-14T07:13:10.820160+0000","last_fullsized":"2024-09-14T07:13:10.820160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:26:14.420176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020154230000000001,"stat_sum":{"num_bytes":22919358,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":3185,"num_read_kb":8586,"num_write":580,"num_write_kb":4095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":2286506,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"3.15","version":"89'303","reported_seq":1119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.817193+0000","last_change":"2024-09-14T07:13:09.817193+0000","last_active":"2024-09-14T07:13:09.817193+0000","last_peered":"2024-09-14T07:13:09.817193+0000","last_clean":"2024-09-14T07:13:09.817193+0000","last_became_active":"2024-09-14T07:12:15.764942+0000","last_became_peered":"2024-09-14T07:12:15.764942+0000","last_unstale":"2024-09-14T07:13:09.817193+0000","last_undegraded":"2024-09-14T07:13:09.817193+0000","last_fullsized":"2024-09-14T07:13:09.817193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:57.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044608799999999997,"stat_sum":{"num_bytes":25099279,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1323,"num_read_kb":15086,"num_write":371,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.14","version":"89'708","reported_seq":3516,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825883+0000","last_change":"2024-09-14T07:13:09.825883+0000","last_active":"2024-09-14T07:13:09.825883+0000","last_peered":"2024-09-14T07:13:09.825883+0000","last_clean":"2024-09-14T07:13:09.825883+0000","last_became_active":"2024-09-14T07:11:51.642949+0000","last_became_peered":"2024-09-14T07:11:51.642949+0000","last_unstale":"2024-09-14T07:13:09.825883+0000","last_undegraded":"2024-09-14T07:13:09.825883+0000","last_fullsized":"2024-09-14T07:13:09.825883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:47:05.664837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010494320000000001,"stat_sum":{"num_bytes":29508843,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":5406,"num_read_kb":29493,"num_write":1109,"num_write_kb":9275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.880136+0000","last_change":"2024-09-14T07:11:44.285521+0000","last_active":"2024-09-14T07:13:09.880136+0000","last_peered":"2024-09-14T07:13:09.880136+0000","last_clean":"2024-09-14T07:13:09.880136+0000","last_became_active":"2024-09-14T07:11:42.162150+0000","last_became_peered":"2024-09-14T07:11:42.162150+0000","last_unstale":"2024-09-14T07:13:09.880136+0000","last_undegraded":"2024-09-14T07:13:09.880136+0000","last_fullsized":"2024-09-14T07:13:09.880136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:34.826117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"89'762","reported_seq":3990,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.815632+0000","last_change":"2024-09-14T07:13:09.815632+0000","last_active":"2024-09-14T07:13:09.815632+0000","last_peered":"2024-09-14T07:13:09.815632+0000","last_clean":"2024-09-14T07:13:09.815632+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:13:09.815632+0000","last_undegraded":"2024-09-14T07:13:09.815632+0000","last_fullsized":"2024-09-14T07:13:09.815632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.528280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014962790000000001,"stat_sum":{"num_bytes":46216749,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":6819,"num_read_kb":29133,"num_write":921,"num_write_kb":10652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806158+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:13:09.806158+0000","last_peered":"2024-09-14T07:13:09.806158+0000","last_clean":"2024-09-14T07:13:09.806158+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:13:09.806158+0000","last_undegraded":"2024-09-14T07:13:09.806158+0000","last_fullsized":"2024-09-14T07:13:09.806158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"89'311","reported_seq":4557,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.816658+0000","last_change":"2024-09-14T07:13:09.816658+0000","last_active":"2024-09-14T07:13:09.816658+0000","last_peered":"2024-09-14T07:13:09.816658+0000","last_clean":"2024-09-14T07:13:09.816658+0000","last_became_active":"2024-09-14T07:11:51.646069+0000","last_became_peered":"2024-09-14T07:11:51.646069+0000","last_unstale":"2024-09-14T07:13:09.816658+0000","last_undegraded":"2024-09-14T07:13:09.816658+0000","last_fullsized":"2024-09-14T07:13:09.816658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:38.258049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673999999999999,"stat_sum":{"num_bytes":19823261,"num_objects":34,"num_object_clones":14,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":5417,"num_read_kb":21582,"num_write":306,"num_write_kb":6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.813898+0000","last_change":"2024-09-14T07:12:15.765521+0000","last_active":"2024-09-14T07:13:09.813898+0000","last_peered":"2024-09-14T07:13:09.813898+0000","last_clean":"2024-09-14T07:13:09.813898+0000","last_became_active":"2024-09-14T07:12:15.765216+0000","last_became_peered":"2024-09-14T07:12:15.765216+0000","last_unstale":"2024-09-14T07:13:09.813898+0000","last_undegraded":"2024-09-14T07:13:09.813898+0000","last_fullsized":"2024-09-14T07:13:09.813898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.152750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'867","reported_seq":4536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806841+0000","last_change":"2024-09-14T07:13:09.806841+0000","last_active":"2024-09-14T07:13:09.806841+0000","last_peered":"2024-09-14T07:13:09.806841+0000","last_clean":"2024-09-14T07:13:09.806841+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:13:09.806841+0000","last_undegraded":"2024-09-14T07:13:09.806841+0000","last_fullsized":"2024-09-14T07:13:09.806841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:16.413345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043783899999999998,"stat_sum":{"num_bytes":32910285,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":11,"num_read":8187,"num_read_kb":22512,"num_write":1196,"num_write_kb":11165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806665+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:13:09.806665+0000","last_peered":"2024-09-14T07:13:09.806665+0000","last_clean":"2024-09-14T07:13:09.806665+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:13:09.806665+0000","last_undegraded":"2024-09-14T07:13:09.806665+0000","last_fullsized":"2024-09-14T07:13:09.806665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'502","reported_seq":1171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.903817+0000","last_change":"2024-09-14T07:13:10.821525+0000","last_active":"2024-09-14T07:13:10.903817+0000","last_peered":"2024-09-14T07:13:10.903817+0000","last_clean":"2024-09-14T07:13:10.903817+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:13:10.903817+0000","last_undegraded":"2024-09-14T07:13:10.903817+0000","last_fullsized":"2024-09-14T07:13:10.903817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:15:06.485988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002433761,"stat_sum":{"num_bytes":21264945,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":1966,"num_read_kb":11505,"num_write":700,"num_write_kb":14788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"3.3","version":"89'319","reported_seq":2435,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881703+0000","last_change":"2024-09-14T07:13:09.825590+0000","last_active":"2024-09-14T07:13:09.881703+0000","last_peered":"2024-09-14T07:13:09.881703+0000","last_clean":"2024-09-14T07:13:09.881703+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:13:09.881703+0000","last_undegraded":"2024-09-14T07:13:09.881703+0000","last_fullsized":"2024-09-14T07:13:09.881703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:20.643276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095568200000000002,"stat_sum":{"num_bytes":50647894,"num_objects":38,"num_object_clones":13,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":2127,"num_read_kb":22236,"num_write":398,"num_write_kb":19006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.2","version":"22'2","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.818598+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:13:10.818598+0000","last_peered":"2024-09-14T07:13:10.818598+0000","last_clean":"2024-09-14T07:13:10.818598+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:13:10.818598+0000","last_undegraded":"2024-09-14T07:13:10.818598+0000","last_fullsized":"2024-09-14T07:13:10.818598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'239","reported_seq":4050,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806526+0000","last_change":"2024-09-14T07:13:09.806526+0000","last_active":"2024-09-14T07:13:09.806526+0000","last_peered":"2024-09-14T07:13:09.806526+0000","last_clean":"2024-09-14T07:13:09.806526+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:13:09.806526+0000","last_undegraded":"2024-09-14T07:13:09.806526+0000","last_fullsized":"2024-09-14T07:13:09.806526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:12.384277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047440200000000002,"stat_sum":{"num_bytes":55073484,"num_objects":38,"num_object_clones":14,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":3989,"num_read_kb":27789,"num_write":227,"num_write_kb":9458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.805897+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:13:09.805897+0000","last_peered":"2024-09-14T07:13:09.805897+0000","last_clean":"2024-09-14T07:13:09.805897+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:13:09.805897+0000","last_undegraded":"2024-09-14T07:13:09.805897+0000","last_fullsized":"2024-09-14T07:13:09.805897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"84'254","reported_seq":3227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.814699+0000","last_change":"2024-09-14T07:13:09.814957+0000","last_active":"2024-09-14T07:13:09.814699+0000","last_peered":"2024-09-14T07:13:09.814699+0000","last_clean":"2024-09-14T07:13:09.814699+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:13:09.814699+0000","last_undegraded":"2024-09-14T07:13:09.814699+0000","last_fullsized":"2024-09-14T07:13:09.814699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:04.574267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001125785,"stat_sum":{"num_bytes":47099771,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":9,"num_read":3287,"num_read_kb":29042,"num_write":281,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.806064+0000","last_change":"2024-09-14T07:12:15.765297+0000","last_active":"2024-09-14T07:13:09.806064+0000","last_peered":"2024-09-14T07:13:09.806064+0000","last_clean":"2024-09-14T07:13:09.806064+0000","last_became_active":"2024-09-14T07:12:15.765018+0000","last_became_peered":"2024-09-14T07:12:15.765018+0000","last_unstale":"2024-09-14T07:13:09.806064+0000","last_undegraded":"2024-09-14T07:13:09.806064+0000","last_fullsized":"2024-09-14T07:13:09.806064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:02.766098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"90'287","reported_seq":1655,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.962044+0000","last_change":"2024-09-14T07:13:10.819507+0000","last_active":"2024-09-14T07:13:10.962044+0000","last_peered":"2024-09-14T07:13:10.962044+0000","last_clean":"2024-09-14T07:13:10.962044+0000","last_became_active":"2024-09-14T07:13:06.770031+0000","last_became_peered":"2024-09-14T07:13:06.770031+0000","last_unstale":"2024-09-14T07:13:10.962044+0000","last_undegraded":"2024-09-14T07:13:10.962044+0000","last_fullsized":"2024-09-14T07:13:10.962044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:51.489057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080793399999999995,"stat_sum":{"num_bytes":19518234,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":12,"num_read":1611,"num_read_kb":10863,"num_write":345,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"2.3","version":"20'1","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.818611+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:13:10.818611+0000","last_peered":"2024-09-14T07:13:10.818611+0000","last_clean":"2024-09-14T07:13:10.818611+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:13:10.818611+0000","last_undegraded":"2024-09-14T07:13:10.818611+0000","last_fullsized":"2024-09-14T07:13:10.818611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.813827+0000","last_change":"2024-09-14T07:12:15.764696+0000","last_active":"2024-09-14T07:13:09.813827+0000","last_peered":"2024-09-14T07:13:09.813827+0000","last_clean":"2024-09-14T07:13:09.813827+0000","last_became_active":"2024-09-14T07:12:15.764436+0000","last_became_peered":"2024-09-14T07:12:15.764436+0000","last_unstale":"2024-09-14T07:13:09.813827+0000","last_undegraded":"2024-09-14T07:13:09.813827+0000","last_fullsized":"2024-09-14T07:13:09.813827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"86'403","reported_seq":2993,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.900747+0000","last_change":"2024-09-14T07:13:09.816955+0000","last_active":"2024-09-14T07:13:09.900747+0000","last_peered":"2024-09-14T07:13:09.900747+0000","last_clean":"2024-09-14T07:13:09.900747+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:13:09.900747+0000","last_undegraded":"2024-09-14T07:13:09.900747+0000","last_fullsized":"2024-09-14T07:13:09.900747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:41.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040893400000000001,"stat_sum":{"num_bytes":17434307,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":4476,"num_read_kb":17744,"num_write":483,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.9","version":"89'488","reported_seq":4147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.826091+0000","last_change":"2024-09-14T07:13:09.826091+0000","last_active":"2024-09-14T07:13:09.826091+0000","last_peered":"2024-09-14T07:13:09.826091+0000","last_clean":"2024-09-14T07:13:09.826091+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:13:09.826091+0000","last_undegraded":"2024-09-14T07:13:09.826091+0000","last_fullsized":"2024-09-14T07:13:09.826091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.166748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011056589999999999,"stat_sum":{"num_bytes":37954895,"num_objects":44,"num_object_clones":15,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":18,"num_read":6344,"num_read_kb":37126,"num_write":478,"num_write_kb":19491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.a","version":"89'346","reported_seq":1993,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.882218+0000","last_change":"2024-09-14T07:13:09.881314+0000","last_active":"2024-09-14T07:13:09.882218+0000","last_peered":"2024-09-14T07:13:09.882218+0000","last_clean":"2024-09-14T07:13:09.882218+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:13:09.882218+0000","last_undegraded":"2024-09-14T07:13:09.882218+0000","last_fullsized":"2024-09-14T07:13:09.882218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:30.508428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200590000000001,"stat_sum":{"num_bytes":38995099,"num_objects":36,"num_object_clones":14,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":1918,"num_read_kb":55145,"num_write":401,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.b","version":"89'265","reported_seq":2520,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881358+0000","last_change":"2024-09-14T07:13:09.815243+0000","last_active":"2024-09-14T07:13:09.881358+0000","last_peered":"2024-09-14T07:13:09.881358+0000","last_clean":"2024-09-14T07:13:09.881358+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:13:09.881358+0000","last_undegraded":"2024-09-14T07:13:09.881358+0000","last_fullsized":"2024-09-14T07:13:09.881358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.502792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001405545,"stat_sum":{"num_bytes":72516826,"num_objects":36,"num_object_clones":13,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":2115,"num_read_kb":21709,"num_write":271,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.c","version":"84'655","reported_seq":5952,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.921842+0000","last_change":"2024-09-14T07:13:10.820161+0000","last_active":"2024-09-14T07:13:10.921842+0000","last_peered":"2024-09-14T07:13:10.921842+0000","last_clean":"2024-09-14T07:13:10.921842+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:13:10.921842+0000","last_undegraded":"2024-09-14T07:13:10.921842+0000","last_fullsized":"2024-09-14T07:13:10.921842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.243172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014038309999999999,"stat_sum":{"num_bytes":65121506,"num_objects":45,"num_object_clones":15,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":14,"num_read":7844,"num_read_kb":25263,"num_write":912,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"3.d","version":"90'584","reported_seq":6502,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T07:13:10.935901+0000","last_change":"2024-09-14T07:13:10.821012+0000","last_active":"2024-09-14T07:13:10.935901+0000","last_peered":"2024-09-14T07:13:10.935901+0000","last_clean":"2024-09-14T07:13:10.935901+0000","last_became_active":"2024-09-14T07:13:06.771593+0000","last_became_peered":"2024-09-14T07:13:06.771593+0000","last_unstale":"2024-09-14T07:13:10.935901+0000","last_undegraded":"2024-09-14T07:13:10.935901+0000","last_fullsized":"2024-09-14T07:13:10.935901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:02.588498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001915627,"stat_sum":{"num_bytes":28878496,"num_objects":38,"num_object_clones":11,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":11,"num_read":9548,"num_read_kb":24861,"num_write":604,"num_write_kb":3804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1812153,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"9"}]},{"pgid":"3.e","version":"89'172","reported_seq":2236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825250+0000","last_change":"2024-09-14T07:13:09.825250+0000","last_active":"2024-09-14T07:13:09.825250+0000","last_peered":"2024-09-14T07:13:09.825250+0000","last_clean":"2024-09-14T07:13:09.825250+0000","last_became_active":"2024-09-14T07:12:15.765001+0000","last_became_peered":"2024-09-14T07:12:15.765001+0000","last_unstale":"2024-09-14T07:13:09.825250+0000","last_undegraded":"2024-09-14T07:13:09.825250+0000","last_fullsized":"2024-09-14T07:13:09.825250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:34.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069921600000000001,"stat_sum":{"num_bytes":35841588,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":8,"num_read":2332,"num_read_kb":24563,"num_write":158,"num_write_kb":11223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.f","version":"86'474","reported_seq":4416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825122+0000","last_change":"2024-09-14T07:13:09.825378+0000","last_active":"2024-09-14T07:13:09.825122+0000","last_peered":"2024-09-14T07:13:09.825122+0000","last_clean":"2024-09-14T07:13:09.825122+0000","last_became_active":"2024-09-14T07:12:15.764966+0000","last_became_peered":"2024-09-14T07:12:15.764966+0000","last_unstale":"2024-09-14T07:13:09.825122+0000","last_undegraded":"2024-09-14T07:13:09.825122+0000","last_fullsized":"2024-09-14T07:13:09.825122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:00.976097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074657200000000003,"stat_sum":{"num_bytes":55249549,"num_objects":49,"num_object_clones":18,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":5402,"num_read_kb":18736,"num_write":539,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.10","version":"89'570","reported_seq":2768,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.881263+0000","last_change":"2024-09-14T07:13:09.881263+0000","last_active":"2024-09-14T07:13:09.881263+0000","last_peered":"2024-09-14T07:13:09.881263+0000","last_clean":"2024-09-14T07:13:09.881263+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:13:09.881263+0000","last_undegraded":"2024-09-14T07:13:09.881263+0000","last_fullsized":"2024-09-14T07:13:09.881263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:21.361259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010614579999999999,"stat_sum":{"num_bytes":20738004,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":4187,"num_read_kb":14723,"num_write":781,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.11","version":"88'247","reported_seq":2783,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.824697+0000","last_change":"2024-09-14T07:13:09.825071+0000","last_active":"2024-09-14T07:13:09.824697+0000","last_peered":"2024-09-14T07:13:09.824697+0000","last_clean":"2024-09-14T07:13:09.824697+0000","last_became_active":"2024-09-14T07:12:15.764948+0000","last_became_peered":"2024-09-14T07:12:15.764948+0000","last_unstale":"2024-09-14T07:13:09.824697+0000","last_undegraded":"2024-09-14T07:13:09.824697+0000","last_fullsized":"2024-09-14T07:13:09.824697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:54.370146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062055699999999999,"stat_sum":{"num_bytes":37444907,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":2705,"num_read_kb":42529,"num_write":257,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.12","version":"89'337","reported_seq":4533,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825010+0000","last_change":"2024-09-14T07:13:09.825010+0000","last_active":"2024-09-14T07:13:09.825010+0000","last_peered":"2024-09-14T07:13:09.825010+0000","last_clean":"2024-09-14T07:13:09.825010+0000","last_became_active":"2024-09-14T07:12:44.655369+0000","last_became_peered":"2024-09-14T07:12:44.655369+0000","last_unstale":"2024-09-14T07:13:09.825010+0000","last_undegraded":"2024-09-14T07:13:09.825010+0000","last_fullsized":"2024-09-14T07:13:09.825010+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:45.896604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048107199999999998,"stat_sum":{"num_bytes":10540105,"num_objects":41,"num_object_clones":13,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":6091,"num_read_kb":8894,"num_write":326,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":1502781,"num_keys_recovered":35,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]},{"pgid":"3.13","version":"89'355","reported_seq":3185,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-14T07:13:09.825586+0000","last_change":"2024-09-14T07:13:09.825586+0000","last_active":"2024-09-14T07:13:09.825586+0000","last_peered":"2024-09-14T07:13:09.825586+0000","last_clean":"2024-09-14T07:13:09.825586+0000","last_became_active":"2024-09-14T07:12:15.765178+0000","last_became_peered":"2024-09-14T07:12:15.765178+0000","last_unstale":"2024-09-14T07:13:09.825586+0000","last_undegraded":"2024-09-14T07:13:09.825586+0000","last_fullsized":"2024-09-14T07:13:09.825586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:50.531979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099369600000000008,"stat_sum":{"num_bytes":43849917,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":3359,"num_read_kb":18650,"num_write":377,"num_write_kb":6992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"20","length":"8"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1142682977,"num_objects":1192,"num_object_clones":391,"num_object_copies":2384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":378,"num_read":138856,"num_read_kb":750406,"num_write":16711,"num_write_kb":400863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":658,"num_bytes_recovered":54938983,"num_keys_recovered":220,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381509632,"data_stored":492799892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":13593,"ondisk_log_size":13593,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70012,"kb_used_data":42928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94301828,"statfs":{"total":96636764160,"available":96565071872,"internally_reserved":0,"allocated":43958272,"data_stored":52868686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56372,"kb_used_data":25172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315468,"statfs":{"total":96636764160,"available":96579039232,"internally_reserved":0,"allocated":25776128,"data_stored":33312892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318275,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82724,"kb_used_data":50124,"kb_used_omap":9,"kb_used_meta":32566,"kb_avail":94289116,"statfs":{"total":96636764160,"available":96552054784,"internally_reserved":0,"allocated":51326976,"data_stored":65656308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":33348232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142752,"kb_used_data":93464,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94229088,"statfs":{"total":96636764160,"available":96490586112,"internally_reserved":0,"allocated":95707136,"data_stored":113422218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110388,"kb_used_data":70876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94261452,"statfs":{"total":96636764160,"available":96523726848,"internally_reserved":0,"allocated":72577024,"data_stored":90190024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63920,"kb_used_data":28572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307920,"statfs":{"total":96636764160,"available":96571310080,"internally_reserved":0,"allocated":29257728,"data_stored":37037141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88368,"kb_used_data":48856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94283472,"statfs":{"total":96636764160,"available":96546275328,"internally_reserved":0,"allocated":50028544,"data_stored":67992386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105808,"kb_used_data":78776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94266032,"statfs":{"total":96636764160,"available":96528416768,"internally_reserved":0,"allocated":80666624,"data_stored":95559367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62947328,"data_stored":78415072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45772800,"data_stored":64301963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25026560,"data_stored":33368989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61673472,"data_stored":79867111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81747968,"data_stored":100032863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":50262016,"data_stored":65162266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24690688,"data_stored":32785984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":38865644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:13:14.650 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T07:13:14.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:13:14.651 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T07:13:14.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-14T07:13:14.673 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.673 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.675 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:14.675+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:14.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:14.777 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:14.776+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:14.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:14.833 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.833 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:13:14.890 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:14.888+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:14.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:14.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:14.970 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:14.970 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:14.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-14T07:13:14.975+0000 7fe4a9aff640 -1 mon.a@0(leader).osd e94 definitely_dead 0 2024-09-14T07:13:14.979 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:14.978+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:14.980 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:14.984 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:14.985 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:15.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:15.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:15.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:15.050 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:15.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:15.066 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:15.079 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:15.079+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:15.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:15.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:15.126 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:15.126 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:15.126 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:15.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:15.180 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:15.180+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.280 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.933309494, 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:13:15.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:13:15.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:13:15.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:13:15.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.933299044999998, 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:15.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.933289091999999, 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:13:15.291 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:13:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:13:15.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.933278168000001, 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:13:15.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:15.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:13:15.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.303 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.303 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:15.303 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.933267924999999, 2024-09-14T07:13:15.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:13:15.304 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.304 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:13:15.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.308 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927322359000001, 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.309 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:13:15.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.314 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.314 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:15.314 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927301224000001, 2024-09-14T07:13:15.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:13:15.314 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:15.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:13:15.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:13:15.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927279729999999, 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:15.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:13:15.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927256702000001, 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:13:15.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927235326999998, 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:13:15.328 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:13:15.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927223908999999, 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:13:15.333 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:13:15.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.337 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927209307999998, 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.338 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:13:15.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:13:15.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927198239999999, 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:13:15.342 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:13:15.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:15.347 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927187379999999, 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:13:15.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927175361, 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:15.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.356 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927165538000001, 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:13:15.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:13:15.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927150810000001, 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:13:15.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:13:15.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927140682000001, 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:15.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:13:15.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.927131127999999, 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:15.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 30.273361651999998, 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:13:15.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:13:15.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.381 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:15.382 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:15.383 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:15.381+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:15.483 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:15.482+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:15.486 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:15.486 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:15.486 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:15.486 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:15.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:15.584 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:15.583+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:15.637 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:15.638 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:15.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:15.692 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:15.691+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:15.751 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:15.751 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.893127755000002, 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.752 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:15.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:15.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:15.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:15.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936657584000002, 2024-09-14T07:13:15.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:15.760 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:15.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:15.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936647264000001, 2024-09-14T07:13:15.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:15.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.769 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936628288000001, 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.770 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936616862999998, 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.775 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:15.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936605366999999, 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:15.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:15.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:15.784 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936594317999997, 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:15.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:15.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936584003, 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:15.789 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.936544750000003, 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.794 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:15.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.930649799999998, 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:15.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:15.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:15.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:15.803 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.930639034000002, 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:15.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.930628775000002, 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.808 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:15.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.930618068999998, 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.930604301999999, 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.930593832, 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.822 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:15.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.924638672999997, 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.924628300999998, 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.831 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:15.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.835 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.924617374, 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:15.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.924607819000002, 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:15.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 30.606655127, 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:15.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:15.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:15.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:15.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:15.851 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:15.851 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:15.851 INFO:teuthology.orchestra.run.smithi071.stderr:marked out osd.7. 2024-09-14T07:13:15.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:15.853 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:15.851+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:15.953 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:15.953+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:15.996 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:15.996 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:15.996 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:15.997 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:16.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:16.054 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:16.053+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:16.107 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:16.107 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:16.108 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:16.108 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:16.108 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:16.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:16.155 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:16.154+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:16.257 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:16.256+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:16.260 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:16.260 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:16.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 98.124196374999997, 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.261 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:16.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:16.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.568879852999999, 2024-09-14T07:13:16.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:16.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:16.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348606955999998, 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:16.274 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:16.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.278 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348585264999997, 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:16.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:16.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348565362000002, 2024-09-14T07:13:16.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:16.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.287 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348543868, 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.288 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:16.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.292 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348525547000001, 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:16.296 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348499203999999, 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.297 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:16.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.301 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348478739000001, 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:16.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:16.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348456884000001, 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:16.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.310 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348438248999997, 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:16.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348412107999998, 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.315 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:16.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.319 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348384590000002, 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:16.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:16.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348367111000002, 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.348354995000001, 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:16.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.334 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.342912976999997, 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:16.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:16.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.342893652999997, 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:16.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.342864802999998, 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:16.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.342824278999998, 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.348 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:16.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.352 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.342802253999999, 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:16.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:16.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:16.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.357 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.357 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.357 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:16.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:16.359 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:16.357+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:16.460 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:16.459+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:16.502 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:16.502 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:16.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102618 3.d 3.ac4d49ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:15.846745+0000", 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.65562735000000005, 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.65564749, 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "waiting for peered", 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102618 2024-09-14T07:13:16.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846745+0000", 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846745+0000", 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846747+0000", 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3360000000000002e-06 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846761+0000", 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3484e-05 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846782+0000", 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0968999999999999e-05 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846793+0000", 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1449e-05 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846858+0000", 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5412000000000003e-05 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.846863+0000", 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7010000000000004e-06 2024-09-14T07:13:16.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.851427+0000", 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045638160000000001 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.851439+0000", 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2408e-05 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102619 3.d 3.ac4d49ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:15.850111+0000", 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.652260646, 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.65232049700000005, 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "waiting for peered", 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102619 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.508 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.850111+0000", 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.850111+0000", 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.850113+0000", 2024-09-14T07:13:16.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5179999999999999e-06 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.850120+0000", 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8190000000000003e-06 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.850132+0000", 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2454e-05 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.850141+0000", 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8750000000000006e-06 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.851467+0000", 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001325665 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.851475+0000", 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7379999999999994e-06 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.511 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.512 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.512 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.512 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-14T07:13:16.512 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 2 2024-09-14T07:13:16.512 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:16.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:16.560 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:16.560+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:16.661 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:16.660+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:16.662 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:16.662 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:16.663 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:16.663 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:16.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:16.762 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:16.761+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:16.775 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:100928 3.1c 3:3fa42aa0:::rbd_object_map.11821cead9c1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.775721+0000", 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.9981957030000004, 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017590990000000001, 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100928 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775721+0000", 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775721+0000", 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775723+0000", 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.795e-06 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775730+0000", 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6080000000000001e-06 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775745+0000", 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4969e-05 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775753+0000", 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4589999999999998e-06 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775857+0000", 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103923 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.776027+0000", 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016970599999999999 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.776245+0000", 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021838399999999999 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.776925+0000", 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068040699999999995 2024-09-14T07:13:16.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.777370+0000", 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044423200000000003 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.777420+0000", 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0083999999999997e-05 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.777480+0000", 2024-09-14T07:13:16.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0532000000000003e-05 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101015 3.5 3:a64521d3:::rbd_data.11821cead9c1.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.937294734, 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043484730000000003, 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101015 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:16.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836623+0000", 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-07 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836627+0000", 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836636+0000", 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9449999999999999e-06 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836642+0000", 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2449999999999998e-06 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836695+0000", 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3735e-05 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836826+0000", 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013094300000000001 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836939+0000", 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112557 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838008+0000", 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001068989 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840911+0000", 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029033010000000001 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840943+0000", 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1738e-05 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840971+0000", 2024-09-14T07:13:16.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7885000000000002e-05 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101019 3.d 3:b5a7ff8e:::rbd_data.11821cead9c1.0000000000000004:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.9372580750000008, 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023170280000000001, 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.788 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101019 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3599999999999999e-07 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836661+0000", 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8950000000000001e-06 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836666+0000", 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2959999999999998e-06 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836670+0000", 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1130000000000001e-06 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836730+0000", 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0495000000000003e-05 2024-09-14T07:13:16.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836811+0000", 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0858000000000004e-05 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836870+0000", 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8785e-05 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838000+0000", 2024-09-14T07:13:16.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011298429999999999 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838869+0000", 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00086922300000000002 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838930+0000", 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1110000000000003e-05 2024-09-14T07:13:16.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838976+0000", 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5973999999999997e-05 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101022 3.d 3:b2e70094:::rbd_data.11821cead9c1.0000000000000007:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:16.794 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.9372293900000006, 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002446026, 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101022 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:16.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-07 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836691+0000", 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6749999999999998e-06 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836696+0000", 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836699+0000", 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1209999999999998e-06 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.837366+0000", 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066703300000000004 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.837472+0000", 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010590300000000001 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.837577+0000", 2024-09-14T07:13:16.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104811 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838350+0000", 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077318999999999999 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.839039+0000", 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068958300000000001 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.839087+0000", 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7206000000000002e-05 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.839134+0000", 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6925000000000002e-05 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3046 3.1f e87/85 3:ffa53dc0:::rbd_data.118239a42b07.0000000000000006:22 v 87'521, mlcod=86'518)", 2024-09-14T07:13:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9729559479999992, 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045671549999999998, 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800967+0000", 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8669999999999999e-06 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800992+0000", 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4555000000000001e-05 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801048+0000", 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6093e-05 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801219+0000", 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017133599999999999 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801245+0000", 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5439000000000002e-05 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805483+0000", 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042387969999999999 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805528+0000", 2024-09-14T07:13:16.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4676999999999999e-05 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3047 3.17 e87/85 3:ea926012:::rbd_data.118239a42b07.000000000000000e:22 v 87'627, mlcod=84'624)", 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.9696875669999994, 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037476889999999998, 2024-09-14T07:13:16.805 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804230+0000", 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804239+0000", 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9269999999999994e-06 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804252+0000", 2024-09-14T07:13:16.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2679e-05 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804261+0000", 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7239999999999998e-06 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804348+0000", 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7134999999999998e-05 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804374+0000", 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6288e-05 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807887+0000", 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035127589999999998 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807977+0000", 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0101999999999999e-05 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101670 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9566626849999995, 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040111699999999997, 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101670 2024-09-14T07:13:16.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817256+0000", 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7e-06 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817265+0000", 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1989999999999995e-06 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817280+0000", 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4952e-05 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817288+0000", 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6879999999999999e-06 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817356+0000", 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7979999999999996e-05 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817365+0000", 2024-09-14T07:13:16.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2450000000000004e-06 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819318+0000", 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019528499999999999 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819415+0000", 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7578999999999995e-05 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819804+0000", 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038904400000000001 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821059+0000", 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001254523 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821156+0000", 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6824999999999995e-05 2024-09-14T07:13:16.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821227+0000", 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1013000000000006e-05 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821265+0000", 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8572000000000003e-05 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101674 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.826223+0000", 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9476936909999996, 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001580115, 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101674 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.817 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826223+0000", 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826223+0000", 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826224+0000", 2024-09-14T07:13:16.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.124e-06 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826229+0000", 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.079e-06 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826242+0000", 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2153999999999999e-05 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826247+0000", 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7950000000000004e-06 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826304+0000", 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6514999999999997e-05 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826397+0000", 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.3268000000000002e-05 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.826573+0000", 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017631 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827207+0000", 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00063310799999999996 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827701+0000", 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000493905 2024-09-14T07:13:16.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827761+0000", 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0939e-05 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827803+0000", 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1918000000000001e-05 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101676 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [watch unwatch cookie 140170150085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9459590919999998, 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041592649999999997, 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101676 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.823 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:16.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827961+0000", 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7769999999999998e-06 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827969+0000", 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827975+0000", 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1e-06 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828225+0000", 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024990199999999998 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828309+0000", 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3647999999999996e-05 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828455+0000", 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657200000000001 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829183+0000", 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072760100000000003 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831875+0000", 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026923089999999999 2024-09-14T07:13:16.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831958+0000", 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2164999999999997e-05 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832117+0000", 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159562 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101677 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9456521789999996, 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039841629999999998, 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101677 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828266+0000", 2024-09-14T07:13:16.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.001e-06 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828271+0000", 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828282+0000", 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0868e-05 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828302+0000", 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0245e-05 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828984+0000", 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068168600000000003 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829038+0000", 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3732e-05 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832153+0000", 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031149929999999999 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832195+0000", 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1853000000000001e-05 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832249+0000", 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4398999999999999e-05 2024-09-14T07:13:16.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3108 3.1f e90/85 3:fc7fddf7:::rbd_data.1182af6f1d9e.0000000000000001:1f v 90'524, mlcod=87'521)", 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.9419472950000003, 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016930420000000001, 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9900000000000002e-07 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831974+0000", 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1450000000000001e-06 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832000+0000", 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6330999999999999e-05 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832008+0000", 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8089999999999993e-06 2024-09-14T07:13:16.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832083+0000", 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4813000000000004e-05 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832104+0000", 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1180000000000001e-05 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.833632+0000", 2024-09-14T07:13:16.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001527416 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.833663+0000", 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1049e-05 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101893 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.947857495, 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003596237, 2024-09-14T07:13:16.838 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101893 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826062+0000", 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1289999999999999e-06 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826071+0000", 2024-09-14T07:13:16.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0310000000000004e-06 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826093+0000", 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2659000000000001e-05 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826104+0000", 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0379e-05 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826226+0000", 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012198500000000001 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826232+0000", 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.533e-06 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.827997+0000", 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017645689999999999 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828088+0000", 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1317999999999995e-05 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828266+0000", 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178102 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829260+0000", 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099377699999999994 2024-09-14T07:13:16.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829563+0000", 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030319599999999999 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829617+0000", 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3384000000000003e-05 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829656+0000", 2024-09-14T07:13:16.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9174999999999997e-05 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101914 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.852382+0000", 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.9215350400000002, 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020425920000000002, 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101914 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852382+0000", 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852382+0000", 2024-09-14T07:13:16.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852384+0000", 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852389+0000", 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0599999999999998e-06 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852400+0000", 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0908e-05 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852406+0000", 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.066e-06 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852461+0000", 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5303999999999998e-05 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852547+0000", 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6014999999999996e-05 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852716+0000", 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016891899999999999 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.853183+0000", 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00046716999999999999 2024-09-14T07:13:16.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.854365+0000", 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011818449999999999 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.854398+0000", 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3470999999999999e-05 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.854424+0000", 2024-09-14T07:13:16.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6077000000000001e-05 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101979 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.894366+0000", 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8795506240000002, 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015436549999999999, 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.851 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101979 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894366+0000", 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894366+0000", 2024-09-14T07:13:16.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894367+0000", 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6899999999999997e-07 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894370+0000", 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4999999999999999e-06 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894379+0000", 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2579999999999995e-06 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894383+0000", 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1729999999999997e-06 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894419+0000", 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6157e-05 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894476+0000", 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6443000000000002e-05 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.894686+0000", 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021080200000000001 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.895257+0000", 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057082699999999999 2024-09-14T07:13:16.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.895842+0000", 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058476700000000003 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.895872+0000", 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9992e-05 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.895910+0000", 2024-09-14T07:13:16.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8067e-05 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101982 3.1d 3:b9b1f89f:::rbd_data.118266971d4e.0000000000000016:head [delete] snapc 1e=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.896100+0000", 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8778171820000003, 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016352890000000001, 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101982 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896100+0000", 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896100+0000", 2024-09-14T07:13:16.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896101+0000", 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1500000000000003e-07 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896105+0000", 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9589999999999997e-06 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896113+0000", 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2260000000000005e-06 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896120+0000", 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0890000000000002e-06 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896368+0000", 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024855800000000001 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896472+0000", 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010350500000000001 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896571+0000", 2024-09-14T07:13:16.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9030000000000006e-05 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897190+0000", 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061897000000000005 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897677+0000", 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048685699999999999 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897708+0000", 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1668000000000002e-05 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897735+0000", 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6611999999999999e-05 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101983 3.1c 3:3aeba798:::rbd_data.118266971d4e.0000000000000017:head [delete] snapc 1e=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.896140+0000", 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8777767609999998, 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016094740000000001, 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101983 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896140+0000", 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896140+0000", 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896141+0000", 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1699999999999998e-07 2024-09-14T07:13:16.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896143+0000", 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6960000000000001e-06 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896151+0000", 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5480000000000004e-06 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896157+0000", 2024-09-14T07:13:16.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6860000000000003e-06 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896203+0000", 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5954000000000001e-05 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896336+0000", 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013311400000000001 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:16.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896463+0000", 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012684999999999999 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897185+0000", 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072202400000000004 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897665+0000", 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048077699999999999 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897710+0000", 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4781999999999999e-05 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897750+0000", 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9425999999999998e-05 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.869 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101987 3.2 3:42edf54c:::rbd_data.118266971d4e.000000000000001f:head [delete] snapc 1e=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8777443529999998, 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018118850000000001, 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101987 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5699999999999998e-07 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896176+0000", 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5040000000000001e-06 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896182+0000", 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5699999999999998e-06 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896187+0000", 2024-09-14T07:13:16.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2460000000000003e-06 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896233+0000", 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5745000000000003e-05 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896314+0000", 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0841999999999996e-05 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896433+0000", 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011924199999999999 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897175+0000", 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00074156099999999996 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897922+0000", 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00074696400000000003 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897953+0000", 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0871000000000003e-05 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897984+0000", 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1883e-05 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101988 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.875 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.8757587349999998, 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059469579999999996, 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101988 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898159+0000", 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1900000000000001e-07 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898163+0000", 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.675e-06 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898170+0000", 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898174+0000", 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1409999999999998e-06 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898209+0000", 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4301000000000002e-05 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898262+0000", 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3282999999999998e-05 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898477+0000", 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214606 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.899294+0000", 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081715499999999996 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904020+0000", 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047267430000000003 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904058+0000", 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7842000000000001e-05 2024-09-14T07:13:16.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904105+0000", 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6864999999999999e-05 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102097 3.c 3:3778db3a:::rbd_object_map.11828c78e1fb:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.978100+0000", 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 4.795817349, 2024-09-14T07:13:16.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015222009999999999, 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102097 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978100+0000", 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978100+0000", 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978101+0000", 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1400000000000001e-06 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978106+0000", 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0379999999999999e-06 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978120+0000", 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4589e-05 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978128+0000", 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978180+0000", 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1480000000000002e-05 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978261+0000", 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1130000000000004e-05 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978359+0000", 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8311000000000001e-05 2024-09-14T07:13:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.978822+0000", 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00046308800000000001 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.979570+0000", 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00074765200000000002 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.979599+0000", 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9118000000000001e-05 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.979622+0000", 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2931000000000001e-05 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3140 3.1f e95/85 3:fc83db16:::rbd_data.1182ebefc99c.0000000000000028:1a v 95'536, mlcod=91'532)", 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:15.856841+0000", 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.91707616400000003, 2024-09-14T07:13:16.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015382289999999999, 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856841+0000", 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856841+0000", 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:16.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856841+0000", 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1800000000000002e-07 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856845+0000", 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9580000000000001e-06 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:16.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856864+0000", 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9001999999999999e-05 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856872+0000", 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4830000000000002e-06 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856930+0000", 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8077e-05 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.856951+0000", 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0956999999999999e-05 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.858339+0000", 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013882149999999999 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:15.858379+0000", 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0219000000000002e-05 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.892 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:16.892 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:16.892 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:16.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:13:16.893 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:16.892+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:16.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:16.994 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:16.993+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:17.010 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:17.010 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:17.010 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:17.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:17.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:17.096 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:17.094+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:17.126 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:17.128 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:17.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:17.219 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:17.218+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:17.220 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:17.220 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:17.238 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:17.238 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:17.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:17.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:17.270 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:17.270 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:17.283 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:17.283 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:17.287 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:17.287 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:17.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:17.297 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:17.297+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:17.304 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:17.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:17.321 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:17.322 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:17.339 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:17.398 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:17.397+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:17.409 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:17.409 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:17.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:17.502 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:17.502+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:17.561 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:17.562 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:17.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:17.600 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:17.599+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:17.651 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:13:17.717 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:17.716+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:17.743 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:17.743 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:17.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:17.801 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:17.800+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:17.901 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:17.900+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:17.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:18.002 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:18.002+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:18.041 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.041 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:18.104 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:18.103+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:18.163 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.163 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:18.214 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:18.213+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:18.306 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:18.306+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:18.316 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.316 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:18.410 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:18.409+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:18.469 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.469 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:18.519 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:18.518+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:18.609 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:18.609+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:18.621 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.621 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:18.711 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:18.710+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:18.739 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.740 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:18.811 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:18.810+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:18.850 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:18.850 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:18.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:18.912 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:18.912+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:19.002 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:19.002 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:19.011 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:19.013 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:19.012+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:19.114 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:19.113+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:19.115 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:19.115 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:19.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:19.216 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:19.215+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:19.228 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:19.228 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:19.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:19.316 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:19.315+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:19.339 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:19.340 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:19.348 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:19.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:19.432 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:19.431+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:19.477 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:19.477 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:19.490 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:19.491 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:19.493 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:19.493 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:19.499 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:19.509 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:19.509 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:19.518 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:19.517+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:19.525 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:19.525 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:19.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:19.542 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:19.558 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:19.558 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:19.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:19.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:19.590 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:19.620 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:19.619+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:19.642 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:19.643 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:19.643 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:19.643 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:19.643 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:19.652 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:19.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:13:19.736 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:19.735+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:19.809 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:19.809 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:19.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:19.809 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:19.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 101.671349208, 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.810 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:19.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:19.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:19.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:19.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.116032685999997, 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:19.818 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:19.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:19.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:19.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.827 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895759789000003, 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:19.828 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:19.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895738098000002, 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.837 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.837 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:19.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.837 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:19.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:19.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895718195000001, 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:19.847 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895696700999999, 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:19.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:19.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:19.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:19.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:19.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.89567838, 2024-09-14T07:13:19.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:19.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:19.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:19.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:19.861 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895652036999998, 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.862 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:19.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:19.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:19.869 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895631571999999, 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:19.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:19.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895609716999999, 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.874 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:19.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.878 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895591082000003, 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.879 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:19.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895564941000004, 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:19.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:19.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895537423, 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:19.891 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:19.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895519944, 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:19.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:19.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.895507828, 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.902 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:19.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.890065810000003, 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.907 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:19.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.890046486000003, 2024-09-14T07:13:19.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:19.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.918 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.890017636000003, 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:19.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:19.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:19.925 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.889977111999997, 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:19.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:19.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.889955086999997, 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:19.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:19.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:19.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:19.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:19.934 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:19.935 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:19.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:19.937 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:19.935+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:20.037 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:20.036+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:20.080 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:20.081 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:20.081 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:20.081 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:20.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:20.137 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:20.137+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:20.192 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:20.192 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:20.192 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:20.192 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:20.193 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:20.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:20.238 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:20.238+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:100928 3.1c 3:3fa42aa0:::rbd_object_map.11821cead9c1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.775721+0000", 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.527502547999999, 2024-09-14T07:13:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017590990000000001, 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 100928 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775721+0000", 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775721+0000", 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775723+0000", 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.795e-06 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775730+0000", 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6080000000000001e-06 2024-09-14T07:13:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775745+0000", 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4969e-05 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775753+0000", 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4589999999999998e-06 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.775857+0000", 2024-09-14T07:13:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103923 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.776027+0000", 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016970599999999999 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.776245+0000", 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021838399999999999 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.776925+0000", 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068040699999999995 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.777370+0000", 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044423200000000003 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.777420+0000", 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0083999999999997e-05 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.777480+0000", 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0532000000000003e-05 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101015 3.5 3:a64521d3:::rbd_data.11821cead9c1.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.466601579000001, 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043484730000000003, 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101015 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836623+0000", 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-07 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836627+0000", 2024-09-14T07:13:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836636+0000", 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9449999999999999e-06 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836642+0000", 2024-09-14T07:13:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2449999999999998e-06 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836695+0000", 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3735e-05 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836826+0000", 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013094300000000001 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836939+0000", 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112557 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838008+0000", 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001068989 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840911+0000", 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029033010000000001 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840943+0000", 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1738e-05 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840971+0000", 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7885000000000002e-05 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101019 3.d 3:b5a7ff8e:::rbd_data.11821cead9c1.0000000000000004:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.46656492, 2024-09-14T07:13:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023170280000000001, 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101019 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836659+0000", 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3599999999999999e-07 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836661+0000", 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8950000000000001e-06 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836666+0000", 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2959999999999998e-06 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836670+0000", 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1130000000000001e-06 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836730+0000", 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0495000000000003e-05 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836811+0000", 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0858000000000004e-05 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836870+0000", 2024-09-14T07:13:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8785e-05 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838000+0000", 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011298429999999999 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838869+0000", 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00086922300000000002 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838930+0000", 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1110000000000003e-05 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838976+0000", 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5973999999999997e-05 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101022 3.d 3:b2e70094:::rbd_data.11821cead9c1.0000000000000007:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.466536235, 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002446026, 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101022 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836688+0000", 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-07 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836691+0000", 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6749999999999998e-06 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836696+0000", 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836699+0000", 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1209999999999998e-06 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.837366+0000", 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00066703300000000004 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.837472+0000", 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010590300000000001 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.837577+0000", 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000104811 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838350+0000", 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077318999999999999 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.839039+0000", 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068958300000000001 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.839087+0000", 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7206000000000002e-05 2024-09-14T07:13:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.839134+0000", 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6925000000000002e-05 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3046 3.1f e87/85 3:ffa53dc0:::rbd_data.118239a42b07.0000000000000006:22 v 87'521, mlcod=86'518)", 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.502262793, 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045671549999999998, 2024-09-14T07:13:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800967+0000", 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8669999999999999e-06 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800992+0000", 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4555000000000001e-05 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801048+0000", 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6093e-05 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801219+0000", 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017133599999999999 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801245+0000", 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5439000000000002e-05 2024-09-14T07:13:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805483+0000", 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042387969999999999 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805528+0000", 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4676999999999999e-05 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3047 3.17 e87/85 3:ea926012:::rbd_data.118239a42b07.000000000000000e:22 v 87'627, mlcod=84'624)", 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.498994412, 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037476889999999998, 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804230+0000", 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804239+0000", 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9269999999999994e-06 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804252+0000", 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2679e-05 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804261+0000", 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7239999999999998e-06 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804348+0000", 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7134999999999998e-05 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804374+0000", 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6288e-05 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807887+0000", 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035127589999999998 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807977+0000", 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0101999999999999e-05 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.342 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101670 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4859695300000002, 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040111699999999997, 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101670 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817256+0000", 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7e-06 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817265+0000", 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1989999999999995e-06 2024-09-14T07:13:20.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817280+0000", 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4952e-05 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817288+0000", 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6879999999999999e-06 2024-09-14T07:13:20.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817356+0000", 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7979999999999996e-05 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:20.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817365+0000", 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2450000000000004e-06 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819318+0000", 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019528499999999999 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819415+0000", 2024-09-14T07:13:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7578999999999995e-05 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819804+0000", 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038904400000000001 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821059+0000", 2024-09-14T07:13:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001254523 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821156+0000", 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6824999999999995e-05 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821227+0000", 2024-09-14T07:13:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1013000000000006e-05 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821265+0000", 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8572000000000003e-05 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101676 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [watch unwatch cookie 140170150085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4752659369999996, 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041592649999999997, 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101676 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:20.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827961+0000", 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7769999999999998e-06 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827969+0000", 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827975+0000", 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1e-06 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828225+0000", 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024990199999999998 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828309+0000", 2024-09-14T07:13:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3647999999999996e-05 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828455+0000", 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657200000000001 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829183+0000", 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072760100000000003 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831875+0000", 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026923089999999999 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831958+0000", 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2164999999999997e-05 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832117+0000", 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159562 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101677 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4749590240000003, 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039841629999999998, 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101677 2024-09-14T07:13:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828266+0000", 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.001e-06 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828271+0000", 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828282+0000", 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0868e-05 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828302+0000", 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0245e-05 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828984+0000", 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068168600000000003 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829038+0000", 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3732e-05 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832153+0000", 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031149929999999999 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832195+0000", 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1853000000000001e-05 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832249+0000", 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4398999999999999e-05 2024-09-14T07:13:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3108 3.1f e90/85 3:fc7fddf7:::rbd_data.1182af6f1d9e.0000000000000001:1f v 90'524, mlcod=87'521)", 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4712541399999992, 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016930420000000001, 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831970+0000", 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9900000000000002e-07 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831974+0000", 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1450000000000001e-06 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832000+0000", 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6330999999999999e-05 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832008+0000", 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8089999999999993e-06 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832083+0000", 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4813000000000004e-05 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832104+0000", 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1180000000000001e-05 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.833632+0000", 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001527416 2024-09-14T07:13:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.833663+0000", 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1049e-05 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101893 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4771643399999999, 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003596237, 2024-09-14T07:13:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101893 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826062+0000", 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1289999999999999e-06 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826071+0000", 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0310000000000004e-06 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826093+0000", 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2659000000000001e-05 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826104+0000", 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0379e-05 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826226+0000", 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012198500000000001 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826232+0000", 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.533e-06 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.827997+0000", 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017645689999999999 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828088+0000", 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1317999999999995e-05 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828266+0000", 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178102 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829260+0000", 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099377699999999994 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829563+0000", 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030319599999999999 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829617+0000", 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3384000000000003e-05 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829656+0000", 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9174999999999997e-05 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.378 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101914 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.852382+0000", 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4508418849999991, 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020425920000000002, 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.379 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101914 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852382+0000", 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852382+0000", 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852384+0000", 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852389+0000", 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0599999999999998e-06 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852400+0000", 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0908e-05 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852406+0000", 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.066e-06 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852461+0000", 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5303999999999998e-05 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852547+0000", 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6014999999999996e-05 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.852716+0000", 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016891899999999999 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.853183+0000", 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00046716999999999999 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.854365+0000", 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011818449999999999 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.854398+0000", 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3470999999999999e-05 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.854424+0000", 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6077000000000001e-05 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101982 3.1d 3:b9b1f89f:::rbd_data.118266971d4e.0000000000000016:head [delete] snapc 1e=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.896100+0000", 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4071240270000001, 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016352890000000001, 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.387 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101982 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896100+0000", 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896100+0000", 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896101+0000", 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1500000000000003e-07 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896105+0000", 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9589999999999997e-06 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896113+0000", 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2260000000000005e-06 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896120+0000", 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0890000000000002e-06 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896368+0000", 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024855800000000001 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896472+0000", 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010350500000000001 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896571+0000", 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9030000000000006e-05 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897190+0000", 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00061897000000000005 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897677+0000", 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048685699999999999 2024-09-14T07:13:20.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897708+0000", 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1668000000000002e-05 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897735+0000", 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6611999999999999e-05 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101987 3.2 3:42edf54c:::rbd_data.118266971d4e.000000000000001f:head [delete] snapc 1e=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4070511979999996, 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018118850000000001, 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101987 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896173+0000", 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5699999999999998e-07 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896176+0000", 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5040000000000001e-06 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896182+0000", 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5699999999999998e-06 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896187+0000", 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2460000000000003e-06 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896233+0000", 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5745000000000003e-05 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896314+0000", 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0841999999999996e-05 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.896433+0000", 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011924199999999999 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897175+0000", 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00074156099999999996 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897922+0000", 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00074696400000000003 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897953+0000", 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0871000000000003e-05 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.897984+0000", 2024-09-14T07:13:20.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1883e-05 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101988 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 8.4050655800000005, 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059469579999999996, 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101988 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898159+0000", 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1900000000000001e-07 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898163+0000", 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.675e-06 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898170+0000", 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:13:20.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898174+0000", 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1409999999999998e-06 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898209+0000", 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4301000000000002e-05 2024-09-14T07:13:20.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898262+0000", 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3282999999999998e-05 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898477+0000", 2024-09-14T07:13:20.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214606 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.899294+0000", 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081715499999999996 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904020+0000", 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047267430000000003 2024-09-14T07:13:20.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904058+0000", 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7842000000000001e-05 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904105+0000", 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6864999999999999e-05 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102779 3.5 3:a1624695:::rbd_object_map.1182fc4f94db:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.64036115100000002, 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041172270000000002, 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.407 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102779 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662864+0000", 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.578e-06 2024-09-14T07:13:20.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662871+0000", 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8210000000000004e-06 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662884+0000", 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.324e-05 2024-09-14T07:13:20.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662900+0000", 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526999999999999e-05 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662966+0000", 2024-09-14T07:13:20.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6024000000000003e-05 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663058+0000", 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1861999999999996e-05 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663178+0000", 2024-09-14T07:13:20.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012068199999999999 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663663+0000", 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048430700000000001 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666909+0000", 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032459440000000002 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666944+0000", 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5748999999999999e-05 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666980+0000", 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5493000000000001e-05 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102865 3.5 3:a1624695:::rbd_object_map.1182fc4f94db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.722934+0000", 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.58028997299999996, 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0018086179999999999, 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102865 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.722934+0000", 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.722934+0000", 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.722935+0000", 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9600000000000008e-07 2024-09-14T07:13:20.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.722940+0000", 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7960000000000003e-06 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.722953+0000", 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3532e-05 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.722961+0000", 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5070000000000003e-06 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.723004+0000", 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3649999999999997e-05 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.723081+0000", 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6791000000000004e-05 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.723431+0000", 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00034952099999999999 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724059+0000", 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062857899999999999 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724688+0000", 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062835799999999998 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724719+0000", 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1438e-05 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724742+0000", 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3450000000000001e-05 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.420 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102867 3.1d 3:bfdcc173:::rbd_data.1182fc4f94db.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724883+0000", 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.57834115100000005, 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002691269, 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102867 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724883+0000", 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724883+0000", 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724884+0000", 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.003e-06 2024-09-14T07:13:20.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724895+0000", 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1083999999999999e-05 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724909+0000", 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4565e-05 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724917+0000", 2024-09-14T07:13:20.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9990000000000008e-06 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724966+0000", 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8884999999999997e-05 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725076+0000", 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011018099999999999 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725177+0000", 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100818 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726965+0000", 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017875160000000001 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.727486+0000", 2024-09-14T07:13:20.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052085300000000005 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.727538+0000", 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2129000000000002e-05 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.727574+0000", 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6235999999999997e-05 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.428 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102872 3.1c 3:3cb8b5e3:::rbd_data.1182fc4f94db.0000000000000011:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.57828500299999996, 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036539760000000002, 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.429 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102872 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2300000000000001e-07 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724946+0000", 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1090000000000003e-06 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724954+0000", 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3920000000000003e-06 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724960+0000", 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8599999999999998e-06 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725015+0000", 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5631999999999999e-05 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725096+0000", 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0519999999999995e-05 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725197+0000", 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101277 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726820+0000", 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001622343 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728502+0000", 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682146 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728551+0000", 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9644000000000001e-05 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728593+0000", 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1430000000000001e-05 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102873 3.d 3:b4509383:::rbd_data.1182fc4f94db.0000000000000012:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724974+0000", 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.57824959600000003, 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020979710000000001, 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:20.437 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102873 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724974+0000", 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724974+0000", 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724975+0000", 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0999999999999999e-07 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724977+0000", 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6759999999999999e-06 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724984+0000", 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0160000000000003e-06 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724990+0000", 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2780000000000001e-06 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725044+0000", 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.397e-05 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725123+0000", 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9019999999999999e-05 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 6", 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725287+0000", 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016420000000000001 2024-09-14T07:13:20.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726753+0000", 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001465835 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726972+0000", 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021900399999999999 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.727026+0000", 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4141000000000002e-05 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.727072+0000", 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6320999999999999e-05 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.444 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:20.445 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:20.445 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:20.446 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:20.446+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:20.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:20.547 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:20.546+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:20.553 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:20.554 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:20.554 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:20.554 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:20.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:20.648 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:20.647+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:20.665 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:20.665 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:20.665 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:20.665 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:20.665 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:20.676 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:13:20.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:20.749 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:20.748+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:20.842 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.983727340000002, 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:13:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:13:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.983691727999997, 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:13:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.980651125999998, 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:13:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:13:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495952174000003, 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:13:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495933442999998, 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:13:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495897814000003, 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:13:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495864353999998, 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:13:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495839359999998, 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:13:20.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:13:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495786160000002, 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:13:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:13:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495765206999998, 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.495729146000002, 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:13:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:13:20.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:20.910 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494178826000002, 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:13:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494163927999999, 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:13:20.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.923 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494152313999997, 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.924 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:13:20.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494129336999997, 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:13:20.930 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:13:20.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494089387999999, 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494067723999997, 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:13:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494019610999999, 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:13:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.494006415999998, 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:13:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:13:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:13:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.493994804000003, 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:13:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:20.962 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:20.963 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-14T07:13:20.963 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:13:20.963 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-14T07:13:20.963 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T07:13:20.963 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T07:13:20.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-14T07:13:20.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:20.965 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:20.962+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:21.064 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:21.063+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:21.110 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:21.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:21.205 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:21.204+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:21.262 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:21.263 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:21.265 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:21.264+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:21.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:21.366 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:21.365+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:21.415 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378823238999999, 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:21.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:13:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:13:21.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378797767000002, 2024-09-14T07:13:21.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:21.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:13:21.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378786093999999, 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:21.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:13:21.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378775318999999, 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:13:21.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:21.434 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378764777999997, 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:21.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:13:21.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:21.440 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378754309999998, 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:21.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378743798000002, 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:13:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.449 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378733459999999, 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.453 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378723117, 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:13:21.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:13:21.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:13:21.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378704528999997, 2024-09-14T07:13:21.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:21.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:13:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378693439000003, 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:21.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:13:21.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378682736999998, 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:13:21.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378661987999998, 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:13:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378636127, 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:13:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378616291, 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:13:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378590668000001, 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:13:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378551858999998, 2024-09-14T07:13:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:13:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:13:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.497 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.378531189999997, 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.498 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:13:21.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:13:21.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.373170260000002, 2024-09-14T07:13:21.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:13:21.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.373155705999999, 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:21.507 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:13:21.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:13:21.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:21.511 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:21.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:21.513 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:21.512+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:21.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:21.613 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:21.612+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:21.666 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:21.666 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:21.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:21.714 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:21.713+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:21.757 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:21.757 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:21.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:21.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:21.806 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:21.807 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:21.811 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:21.814 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:21.814+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:21.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:21.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:21.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:21.845 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:21.846 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:21.863 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:21.863 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:21.879 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:21.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:21.916 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:21.915+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:21.932 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:21.933 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:21.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:22.017 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:22.016+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:22.045 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.046 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:22.139 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:22.138+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:22.198 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.198 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:22.247 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:22.246+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:22.320 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:22.319+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:22.349 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.350 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:22.421 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:22.420+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:22.473 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.473 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:22.521 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:22.521+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:22.623 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:22.622+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:22.626 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.626 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:22.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:13:22.736 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:22.735+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:22.787 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.788 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:22.825 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:22.824+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:22.898 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:22.899 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:22.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:22.951 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:22.950+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:23.009 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.010 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.018 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:23.027 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:23.026+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:23.128 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:23.127+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:23.160 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.160 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:23.229 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:23.228+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:23.271 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.271 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:23.330 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:23.329+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:23.382 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.382 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:23.435 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:23.434+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:23.493 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.493 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:23.533 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:23.532+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:23.633 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:23.633+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:23.643 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.643 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:13:23.737 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:23.736+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:23.801 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.801 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:23.852 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:23.850+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:23.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:23.936 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:23.935+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:23.954 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:23.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:24.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:24.032 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:24.037 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:24.036+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:24.049 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:24.049 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:24.065 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:24.069 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:24.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:24.069 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:24.069 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:24.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:24.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:24.099 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:24.116 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:24.116 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:24.133 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:24.133 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:24.138 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:24.137+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:24.185 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:24.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:24.186 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:24.186 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:24.186 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:24.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:24.239 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:24.238+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:24.338 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.479671738999997, 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:13:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:13:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.479636126999999, 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:13:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:13:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:13:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:13:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:13:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:13:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.476595525, 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:13:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:13:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:13:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:13:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:13:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:13:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:13:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:13:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:13:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:13:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991896572999998, 2024-09-14T07:13:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:13:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:13:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:13:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:13:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:13:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:13:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991877842000001, 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:13:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:13:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:13:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:13:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:13:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:13:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:13:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:13:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:13:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:13:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:13:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991842212999998, 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:13:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991808753000001, 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:13:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:13:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991783759, 2024-09-14T07:13:24.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:13:24.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.399 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991730558999997, 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.400 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:13:24.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:13:24.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.404 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991709606000001, 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.405 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:13:24.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:13:24.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.991673544999998, 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:13:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.990123224999998, 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:13:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:13:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.990108327000002, 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:13:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.990096713, 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:13:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.990073735999999, 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:13:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.990033787000002, 2024-09-14T07:13:24.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:13:24.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.990012123, 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:13:24.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.447 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.989964010000001, 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.989950815, 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:13:24.453 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.989939202999999, 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.458 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:13:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:13:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:13:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.463 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:24.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:24.465 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:24.464+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:24.566 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:24.565+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:24.607 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:24.608 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:24.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:24.667 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:24.666+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:24.729 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:24.729 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:24.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:24.779 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:24.778+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:24.868 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:24.868+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:24.884 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:24.884 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:24.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:24.884 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:24.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847533722999998, 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.885 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:13:24.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:13:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847508251000001, 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:13:24.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847496577999998, 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:13:24.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:13:24.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847485802999998, 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:13:24.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847475262000003, 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.904 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847464793999997, 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:13:24.908 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847454282000001, 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.913 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:24.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:13:24.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847443943999998, 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.921 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847433600999999, 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847415013000003, 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:24.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847403923000002, 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.931 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:13:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:13:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847393220999997, 2024-09-14T07:13:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:13:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847372472000004, 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:13:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.944 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847346610999999, 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:13:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847326774999999, 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:13:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847301152, 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:13:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:13:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847262342999997, 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:13:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.847241674000003, 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:13:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:13:24.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:13:24.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.841880744000001, 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:24.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:13:24.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.841866189999998, 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:13:24.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:13:24.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:24.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:24.977 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:24.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:24.979 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:24.978+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:25.080 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:25.079+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:25.081 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:25.082 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:25.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:25.181 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:25.180+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:25.193 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:25.193 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:25.193 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:25.193 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:25.193 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:25.202 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:25.282 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:25.282+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.537850641000006, 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:13:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.536751752000001, 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:13:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.509908593000006, 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:13:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:13:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.496614588, 2024-09-14T07:13:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:13:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.496545174000005, 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 73.656167148999998, 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:13:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:13:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.480575911000003, 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:13:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:13:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.190511014999998, 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:13:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.186482717000004, 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:13:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 67.965483594000005, 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:13:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 67.961965782999997, 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:13:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.491826803000002, 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:13:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.839463463000001, 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:13:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.500965022000003, 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:13:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:13:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.495317118999999, 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:13:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:13:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.757830435999999, 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:13:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.529944534999998, 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:13:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.277247760999998, 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:13:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.235300150999997, 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(osd.4.0:3560 3.9 e87/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:22 v 87'485, mlcod=86'482)", 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.506177527999998, 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038721369999999999, 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798537+0000", 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7700000000000005e-07 2024-09-14T07:13:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798543+0000", 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798553+0000", 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.611e-06 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798562+0000", 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4210000000000001e-06 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798621+0000", 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9264e-05 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798642+0000", 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0996e-05 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802363+0000", 2024-09-14T07:13:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037204899999999999 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802408+0000", 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5435999999999997e-05 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.397 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:25.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:25.399 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:25.398+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:25.500 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:25.499+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:25.501 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:25.501 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:25.501 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:25.501 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:25.510 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:25.601 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:25.600+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:25.652 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:25.652 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:25.652 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:25.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:25.702 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:25.701+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:25.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:13:25.787 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.787 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816372367, 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.788 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816340014999994, 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:13:25.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816255364, 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:13:25.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816230004999994, 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:13:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816197297000002, 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:13:25.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:13:25.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816165173000002, 2024-09-14T07:13:25.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:13:25.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:13:25.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:25.816 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816133754999996, 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:25.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:13:25.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:13:25.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.820 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816109785999998, 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.821 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:25.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:13:25.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816090087999996, 2024-09-14T07:13:25.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:13:25.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816076146, 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:13:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816064916000002, 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:13:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816053788000005, 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:13:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816042625999998, 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816031914999996, 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:13:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816022208000007, 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:13:25.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816012643999997, 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:13:25.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.816003308000006, 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:25.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:13:25.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.815993116000001, 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:13:25.867 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.815972739000003, 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.872 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:13:25.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.815926695000002, 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:25.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:25.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:13:25.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:25.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:25.880 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:25.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:25.882 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:25.881+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:25.983 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:25.982+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:25.985 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:25.985 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:25.985 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:25.985 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:25.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:26.083 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:26.083+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:26.097 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:26.097 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:26.097 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:26.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:26.120 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-14T07:13:26.120 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:13:26.120 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-14T07:13:26.120 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T07:13:26.120 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T07:13:26.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-14T07:13:26.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:26.190 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:26.189+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:26.251 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:26.251 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T07:13:26.251 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.253 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.906266864999999, 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:13:26.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:13:26.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.906256415999998, 2024-09-14T07:13:26.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:26.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:13:26.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.906246463000002, 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:26.267 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.906235539000001, 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.271 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.906225296000002, 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.272 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900279730000001, 2024-09-14T07:13:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:13:26.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900258594999997, 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:13:26.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900237101000002, 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.286 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:13:26.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.290 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900214073000001, 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:26.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:13:26.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900192697999998, 2024-09-14T07:13:26.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:26.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:13:26.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900181279999998, 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.300 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:13:26.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900166679000002, 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:13:26.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:26.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900155611000002, 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:13:26.309 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:13:26.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900144750999999, 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.314 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:13:26.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900132732000003, 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:13:26.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900122908999997, 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900108181, 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.328 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:13:26.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.332 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900098053000001, 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:26.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:13:26.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.900088498999999, 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:13:26.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.341 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.246319022999998, 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:26.342 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:13:26.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:13:26.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.347 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:26.348 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:26.349 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:26.350 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:26.351 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:26.352 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:26.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:26.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:26.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:26.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:26.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:26.353 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:26.348+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:26.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:26.380 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:26.380 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:26.450 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:26.450+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:26.493 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:26.494 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:26.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:26.551 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:26.551+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:26.604 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:26.604 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:26.613 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:26.653 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:26.652+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:26.654 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:13:26.726 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:26.726 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:26.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:26.753 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:26.753+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:26.839 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:26.840 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:26.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:26.892 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:26.891+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:26.951 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:26.951 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:26.955 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:26.955+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:26.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:27.057 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:27.056+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:27.103 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.103 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.111 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:27.158 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:27.157+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:27.215 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.215 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:27.259 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:27.258+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:27.359 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:27.359+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:27.366 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.366 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:27.461 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:27.460+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:27.518 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.518 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:27.571 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:27.570+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:27.642 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.642 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:27.697 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:27.696+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:27.763 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:27.762+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:27.806 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.806 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:27.899 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:27.898+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:27.959 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:27.959 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:27.964 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:27.963+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:27.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:28.065 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:28.064+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:28.111 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:28.111 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:28.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:28.166 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:28.165+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:28.223 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:28.223 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:28.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:28.267 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:28.266+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:28.367 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:28.367+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:28.374 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:28.374 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:28.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:28.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:28.468 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:28.468+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:28.532 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:28.532 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:28.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:28.548 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:28.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:28.569 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:28.568+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:28.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:28.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:28.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:28.615 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:28.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:28.632 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:28.645 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:28.645 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:28.645 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:28.646 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:28.646 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:28.649 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:28.650 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:28.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:28.671 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:28.671 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:28.672 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:28.670+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:28.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:13:28.770 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:28.770+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7869 3.9 e34/23 3:9630ba69:::rbd_data.1182a7d91484.0000000000000034:head v 34'33, mlcod=32'29)", 2024-09-14T07:13:28.795 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 85.027199945000007, 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033191610000000002, 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766863+0000", 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766864+0000", 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2600000000000002e-07 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766893+0000", 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8753999999999999e-05 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766906+0000", 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3396e-05 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.766913+0000", 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767007+0000", 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4030999999999995e-05 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767028+0000", 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1367000000000001e-05 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770149+0000", 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003120107 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.770182+0000", 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3809000000000001e-05 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 85.026101056000002, 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:13:28.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:13:28.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12183 3.0 e37/23 3:05cd69e4:::rbd_data.1182344c2865.0000000000000011:head v 37'38, mlcod=36'35)", 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.999257897000007, 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00352616, 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794805+0000", 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794806+0000", 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6600000000000002e-07 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794820+0000", 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4087000000000001e-05 2024-09-14T07:13:28.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794836+0000", 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6166000000000001e-05 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794845+0000", 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9080000000000001e-06 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794906+0000", 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1051999999999998e-05 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.794927+0000", 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1341000000000001e-05 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798292+0000", 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033645200000000002 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:06.798331+0000", 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9719999999999999e-05 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.985963892000001, 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:28.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:13:28.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:13:28.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.985894478000006, 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:13:28.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:13:28.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:13:28.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.145516452999999, 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.821 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:19761 3.4 e47/23 3:23bd538e:::rbd_header.118272ecf6fb:head v 47'84, mlcod=44'82)", 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 71.969925215000004, 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003363506, 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824138+0000", 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2000000000000001e-07 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824145+0000", 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0079999999999996e-06 2024-09-14T07:13:28.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824154+0000", 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000006e-06 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824161+0000", 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4649999999999997e-06 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824204+0000", 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3349000000000001e-05 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.824225+0000", 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0826e-05 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827447+0000", 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032214159999999999 2024-09-14T07:13:28.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.827501+0000", 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4792e-05 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 71.679860318999999, 2024-09-14T07:13:28.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:28.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 71.675832021000005, 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:13:28.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 71.454832898000006, 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:13:28.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 71.451315086999998, 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:13:28.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.981176107000003, 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.328812767000002, 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:13:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.990314326000004, 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:13:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:13:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.984666423, 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.24717974, 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:13:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.019293838999999, 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:13:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:13:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.766597064999999, 2024-09-14T07:13:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.724649454999998, 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:13:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:13:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:13:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(osd.4.0:3560 3.9 e87/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:22 v 87'485, mlcod=86'482)", 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.995526831999999, 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038721369999999999, 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798537+0000", 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7700000000000005e-07 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798543+0000", 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798553+0000", 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.611e-06 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798562+0000", 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4210000000000001e-06 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798621+0000", 2024-09-14T07:13:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9264e-05 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798642+0000", 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0996e-05 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802363+0000", 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037204899999999999 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802408+0000", 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5435999999999997e-05 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:28.885 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:28.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:28.887 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:28.885+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:28.987 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:28.987+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:29.031 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:29.032 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:29.032 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:29.032 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:29.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:29.089 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:29.088+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:29.183 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:29.183 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:29.183 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:29.183 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:29.184 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:29.190 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:29.189+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:29.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:29.291 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:29.290+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:29.336 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:29.336 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:29.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365941090000007, 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:13:29.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.341 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365908738000002, 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365824086999993, 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:13:29.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:13:29.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365798728000001, 2024-09-14T07:13:29.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:29.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:13:29.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365766019999995, 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:29.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365733895999995, 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.361 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:29.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:13:29.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365702478000003, 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:13:29.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365678509000006, 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:13:29.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:13:29.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365658811000003, 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:13:29.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:13:29.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:13:29.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365644868999993, 2024-09-14T07:13:29.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:13:29.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365633638999995, 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365622510999998, 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:13:29.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:13:29.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365611349000005, 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:29.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:13:29.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365600638000004, 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:13:29.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:29.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:13:29.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365590931, 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:13:29.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.405 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365581367000004, 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:29.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:13:29.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:13:29.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365572030999999, 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.414 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365561838999994, 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:29.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365541461999996, 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:13:29.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.365495417999995, 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:13:29.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:29.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:13:29.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:29.428 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:29.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:29.430 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:29.429+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:29.530 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:29.529+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:29.544 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:29.544 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:29.545 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:29.545 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:29.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:29.631 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:29.630+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:29.699 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:29.700 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:29.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:29.714 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:13:29.732 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:29.732+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.472016920000002, 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:13:29.819 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:29.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:13:29.823 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.472006471, 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.824 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:13:29.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.471996517999997, 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:13:29.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:13:29.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:13:29.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.471985594000003, 2024-09-14T07:13:29.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:13:29.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:13:29.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.471975350999998, 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:13:29.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:13:29.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.466029785000003, 2024-09-14T07:13:29.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.846 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.466008649999999, 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.847 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.851 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465987155999997, 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:29.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:29.856 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465964128000003, 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:13:29.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465942753, 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.861 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:13:29.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465931335000001, 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.866 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:13:29.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465916733999997, 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.871 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:13:29.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:13:29.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.875 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465905665999998, 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:13:29.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465894806000001, 2024-09-14T07:13:29.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:13:29.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465882786999998, 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.885 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:13:29.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465872963999999, 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:13:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:13:29.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.894 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465858236000003, 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:13:29.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465848108000003, 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.899 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:13:29.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.903 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.465838554000001, 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.904 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:13:29.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.908 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.812069078, 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:29.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:13:29.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:13:29.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:13:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:29.915 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:29.915 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:29.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:29.917 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:29.915+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:30.017 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:30.016+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:30.018 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:30.019 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:30.019 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:30.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:30.118 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:30.117+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:30.170 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:30.170 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:30.171 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:30.171 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:30.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:30.220 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:30.219+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:30.320 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:30.320+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:30.322 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:30.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.464363925000001, 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:30.323 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:30.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:30.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:30.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507893754000001, 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.331 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:30.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507883434, 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:30.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507864458, 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:30.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507853033000004, 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.346 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:30.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507841536999997, 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.351 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:30.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507830488000003, 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.356 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:30.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:30.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.361 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507820172999999, 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.362 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:30.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.507780920000002, 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.367 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:30.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.371 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.501885970000004, 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.372 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:30.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.501875204000001, 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:30.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.501864945000001, 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.382 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.386 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.501854238999996, 2024-09-14T07:13:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:30.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.501840471999998, 2024-09-14T07:13:30.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:30.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.501830001999998, 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.397 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:30.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:30.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.495874843000003, 2024-09-14T07:13:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.495864470999997, 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.495853543999999, 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 54.495843989000001, 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.177891297000002, 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.428 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:30.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:30.430 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:30.429+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:30.531 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:30.530+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:30.574 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:30.575 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:30.575 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:30.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:30.632 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:30.631+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:30.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:30.727 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:30.727 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:30.728 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:30.733 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:30.732+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:30.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:30.825 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:30.833 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:30.832+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:30.842 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:30.858 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:30.874 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:30.885 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:30.885 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 112.748199781, 2024-09-14T07:13:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:30.886 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:30.887 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:30.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:30.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:30.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:30.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:30.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:30.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:30.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:30.896 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.192883258999998, 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:30.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:30.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972610361999998, 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.903 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:30.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:30.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972588670999997, 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.908 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:30.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:30.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972568768000002, 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.913 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:30.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:30.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972547273999993, 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.918 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:30.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.922 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972528952999994, 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.923 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:30.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:30.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972502610000006, 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:30.928 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.933 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972482145000001, 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:30.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972460290000001, 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.938 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:30.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:30.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972441654999997, 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.943 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:30.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972415514000005, 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:30.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:30.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:30.952 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972387995999995, 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:30.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.957 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972370517000002, 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:30.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:30.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:30.962 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.972358400999994, 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.966916382999997, 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.968 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.966897059000004, 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.973 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:30.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.966868208999998, 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:30.978 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.983 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.966827684999998, 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:30.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:30.988 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.966805660000006, 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:30.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:30.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:30.993 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:30.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:30.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:30.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:30.996 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:30.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:30.997 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:30.994+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:30.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:30.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:30.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:31.000 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:31.096 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:31.095+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:31.139 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.139 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:31.196 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:31.196+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:31.250 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.250 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:31.302 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:31.301+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:31.351 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-14T07:13:31.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T07:13:31.360 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.361 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:31.410 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:31.410+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:31.499 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:31.498+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:31.503 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.503 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:31.599 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:31.599+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:31.662 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.662 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:31.700 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:31.700+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:31.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:13:31.801 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:31.801+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.834 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:31.902 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:31.901+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:31.950 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:31.950 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:31.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:32.003 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:32.003+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:32.102 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:32.102 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:32.104 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:32.104+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:32.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:32.205 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:32.204+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:32.254 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:32.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:32.306 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:32.305+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:32.407 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:32.406+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:32.407 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:32.407 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:32.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:32.507 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:32.507+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:32.558 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:32.558 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:32.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:32.611 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:32.610+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:32.648 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T07:13:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:13:32.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T07:13:32.680 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:32.680 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:32.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:32.731 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:32.730+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:32.810 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:32.810+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:32.853 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:32.854 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:32.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:32.948 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:32.947+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:33.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:33.009 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:33.009 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:33.013 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:33.012+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:33.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:33.116 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:33.113+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:33.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:33.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:33.143 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:33.144 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:33.160 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:33.160 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:33.168 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:33.176 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:33.176 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:33.177 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:33.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:33.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:33.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:33.209 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:33.215 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:33.214+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:33.225 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:33.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:33.241 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:33.241 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:33.284 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:33.284 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:33.284 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:33.284 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:33.293 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:33.337 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:33.336+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:33.395 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:33.396 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:33.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:33.445 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:33.444+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:33.517 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:33.516+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:33.548 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:33.548 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:33.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:33.548 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:33.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.201416240999997, 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:13:33.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:13:33.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:33.553 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.201405792000003, 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:33.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:13:33.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.201395839, 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:13:33.558 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:33.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:13:33.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.201384914999998, 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:13:33.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.201374672, 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:13:33.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:13:33.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:13:33.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.572 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.573 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.573 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:33.573 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195429105999999, 2024-09-14T07:13:33.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:13:33.573 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.573 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.574 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:13:33.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:13:33.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:13:33.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:13:33.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:13:33.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:13:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:13:33.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195407971000002, 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.581 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:13:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195386477, 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.586 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:33.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:13:33.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:13:33.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:13:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:13:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:13:33.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:13:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:13:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:13:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:13:33.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:13:33.592 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:33.593 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195363448999998, 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.594 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195342074000003, 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.599 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:33.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:13:33.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195330656000003, 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.604 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:13:33.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195316054999999, 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:13:33.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:13:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:13:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195304987, 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:13:33.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195294126999997, 2024-09-14T07:13:33.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:33.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:13:33.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:13:33.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195282108000001, 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:13:33.623 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.627 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195272285000001, 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.628 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:13:33.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:13:33.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195257556999998, 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195247428999998, 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:33.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:13:33.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.195237874999997, 2024-09-14T07:13:33.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:13:33.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.541468399000003, 2024-09-14T07:13:33.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:13:33.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:13:33.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:13:33.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:13:33.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:13:33.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:13:33.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:33.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.655 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:33.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:33.657 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:33.656+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:33.734 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T07:13:33.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T07:13:33.756 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:33.756+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:33.811 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:33.811 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:105184 3.a 3:5644ff91:::rbd_object_map.1182dfea3896:head [call lock.assert_locked in=44b,call rbd.object_map_update in=39b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:33.811181+0000", 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.00024822400000000001, 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026730299999999999, 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:33.812 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 105184 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811181+0000", 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811181+0000", 2024-09-14T07:13:33.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811182+0000", 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0100000000000001e-06 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811186+0000", 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1670000000000001e-06 2024-09-14T07:13:33.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811196+0000", 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811201+0000", 2024-09-14T07:13:33.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.378e-06 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811246+0000", 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4839999999999998e-05 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:33.811300+0000", 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4555000000000002e-05 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:33.817 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2024-09-14T07:13:33.817 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 1 2024-09-14T07:13:33.817 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:33.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:33.862 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:33.861+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:33.958 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:33.957+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:33.964 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:33.965 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:33.965 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:33.965 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:33.965 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:33.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:34.059 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:34.058+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:34.117 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:34.117 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:34.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.259169642000003, 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:34.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:34.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:34.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:34.124 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302699470999997, 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:34.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.128 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302689151000003, 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:34.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.130 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:34.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:34.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:34.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302670175000003, 2024-09-14T07:13:34.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:34.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:34.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:34.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:34.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:34.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.142 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302658749999999, 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:34.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:34.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302647254, 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.148 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:34.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302636204999999, 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.153 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:34.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302625890000002, 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:34.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:34.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.302586636999997, 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.163 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:34.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:34.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:34.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.168 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.296691686999999, 2024-09-14T07:13:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.296680920999997, 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.176 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:34.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.296670661999997, 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.181 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:34.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.296659955999999, 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:34.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:34.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:34.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.296646189000001, 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.191 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:34.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.296635719000001, 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:34.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:34.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.290680559999998, 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:34.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.290670188, 2024-09-14T07:13:34.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:34.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:34.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.290659261000002, 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:34.210 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:34.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:34.214 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 58.290649706000004, 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.215 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:34.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:34.219 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.972697013999998, 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:34.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:34.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:34.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.225 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:34.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:34.227 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:34.226+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:34.328 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:34.327+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:34.370 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:34.371 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:34.371 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:34.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:34.429 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:34.428+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:34.482 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:34.482 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:34.482 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:34.482 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:34.482 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:34.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:34.530 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:34.530+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:34.631 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:34.630+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:34.635 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 116.499008223, 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 91.943691701000006, 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723418804000005, 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723397113000004, 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723377209999995, 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723355716, 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723337395000001, 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723311052, 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723290586999994, 2024-09-14T07:13:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723268731999994, 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723250097000005, 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723223955999998, 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723196438000002, 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723178958999995, 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.723166843000001, 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.717724825000005, 2024-09-14T07:13:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:34.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:34.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:34.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:34.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:34.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:34.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.717705500999998, 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:34.722 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.727 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.717676651000005, 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:34.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.717636127000006, 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:34.732 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:34.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.737 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.717614101999999, 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:34.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:34.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:34.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:34.742 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:34.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:13:34.743 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T07:13:34.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:34.745 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:34.743+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:34.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T07:13:34.844 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:34.843+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:34.894 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:34.894 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:34.894 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:34.894 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:34.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:34.946 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:34.945+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:35.045 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:35.044+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:35.046 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:35.046 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:35.046 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:35.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:35.146 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:35.146+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:35.199 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:35.199 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101015 3.5 3:a64521d3:::rbd_data.11821cead9c1.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.360870070000001, 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043484730000000003, 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.200 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101015 2024-09-14T07:13:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836623+0000", 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-07 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836627+0000", 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836636+0000", 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9449999999999999e-06 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836642+0000", 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2449999999999998e-06 2024-09-14T07:13:35.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836695+0000", 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3735e-05 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836826+0000", 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013094300000000001 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836939+0000", 2024-09-14T07:13:35.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112557 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838008+0000", 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001068989 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840911+0000", 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029033010000000001 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840943+0000", 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1738e-05 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840971+0000", 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7885000000000002e-05 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.206 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3046 3.1f e87/85 3:ffa53dc0:::rbd_data.118239a42b07.0000000000000006:22 v 87'521, mlcod=86'518)", 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.396531284000002, 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045671549999999998, 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800967+0000", 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8669999999999999e-06 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800992+0000", 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4555000000000001e-05 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801048+0000", 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6093e-05 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801219+0000", 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017133599999999999 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801245+0000", 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5439000000000002e-05 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805483+0000", 2024-09-14T07:13:35.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042387969999999999 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805528+0000", 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4676999999999999e-05 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3047 3.17 e87/85 3:ea926012:::rbd_data.118239a42b07.000000000000000e:22 v 87'627, mlcod=84'624)", 2024-09-14T07:13:35.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.393262903, 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037476889999999998, 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804230+0000", 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804239+0000", 2024-09-14T07:13:35.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9269999999999994e-06 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804252+0000", 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2679e-05 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804261+0000", 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7239999999999998e-06 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804348+0000", 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7134999999999998e-05 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804374+0000", 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6288e-05 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807887+0000", 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035127589999999998 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807977+0000", 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0101999999999999e-05 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101670 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.380238021, 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040111699999999997, 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101670 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817256+0000", 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7e-06 2024-09-14T07:13:35.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817265+0000", 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1989999999999995e-06 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817280+0000", 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4952e-05 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817288+0000", 2024-09-14T07:13:35.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6879999999999999e-06 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817356+0000", 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7979999999999996e-05 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817365+0000", 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2450000000000004e-06 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819318+0000", 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019528499999999999 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819415+0000", 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7578999999999995e-05 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819804+0000", 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038904400000000001 2024-09-14T07:13:35.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821059+0000", 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001254523 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821156+0000", 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6824999999999995e-05 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821227+0000", 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1013000000000006e-05 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821265+0000", 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8572000000000003e-05 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.223 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101676 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [watch unwatch cookie 140170150085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.369534428000001, 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041592649999999997, 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101676 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:35.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827961+0000", 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7769999999999998e-06 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827969+0000", 2024-09-14T07:13:35.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827975+0000", 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1e-06 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828225+0000", 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024990199999999998 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828309+0000", 2024-09-14T07:13:35.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3647999999999996e-05 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828455+0000", 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657200000000001 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829183+0000", 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072760100000000003 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831875+0000", 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026923089999999999 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831958+0000", 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2164999999999997e-05 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832117+0000", 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159562 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101677 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.369227514999999, 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039841629999999998, 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.230 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101677 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:35.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828266+0000", 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.001e-06 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828271+0000", 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828282+0000", 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0868e-05 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828302+0000", 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0245e-05 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828984+0000", 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068168600000000003 2024-09-14T07:13:35.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829038+0000", 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3732e-05 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832153+0000", 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031149929999999999 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832195+0000", 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1853000000000001e-05 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832249+0000", 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4398999999999999e-05 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101893 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.371432831, 2024-09-14T07:13:35.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003596237, 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101893 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826062+0000", 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1289999999999999e-06 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826071+0000", 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0310000000000004e-06 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826093+0000", 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2659000000000001e-05 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826104+0000", 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0379e-05 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826226+0000", 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012198500000000001 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826232+0000", 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.533e-06 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.827997+0000", 2024-09-14T07:13:35.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017645689999999999 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828088+0000", 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1317999999999995e-05 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828266+0000", 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178102 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829260+0000", 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099377699999999994 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829563+0000", 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030319599999999999 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829617+0000", 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3384000000000003e-05 2024-09-14T07:13:35.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829656+0000", 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9174999999999997e-05 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101988 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.299334071000001, 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059469579999999996, 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101988 2024-09-14T07:13:35.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898159+0000", 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1900000000000001e-07 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898163+0000", 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.675e-06 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898170+0000", 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898174+0000", 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1409999999999998e-06 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898209+0000", 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4301000000000002e-05 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898262+0000", 2024-09-14T07:13:35.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3282999999999998e-05 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898477+0000", 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214606 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.899294+0000", 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081715499999999996 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904020+0000", 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047267430000000003 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904058+0000", 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7842000000000001e-05 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904105+0000", 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6864999999999999e-05 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.249 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102779 3.5 3:a1624695:::rbd_object_map.1182fc4f94db:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.534629642000001, 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041172270000000002, 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.250 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102779 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662864+0000", 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.578e-06 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662871+0000", 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8210000000000004e-06 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662884+0000", 2024-09-14T07:13:35.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.324e-05 2024-09-14T07:13:35.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662900+0000", 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526999999999999e-05 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662966+0000", 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6024000000000003e-05 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663058+0000", 2024-09-14T07:13:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1861999999999996e-05 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663178+0000", 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012068199999999999 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663663+0000", 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048430700000000001 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666909+0000", 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032459440000000002 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666944+0000", 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5748999999999999e-05 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666980+0000", 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5493000000000001e-05 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102872 3.1c 3:3cb8b5e3:::rbd_data.1182fc4f94db.0000000000000011:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 15.472553494, 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036539760000000002, 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.257 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102872 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2300000000000001e-07 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724946+0000", 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1090000000000003e-06 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724954+0000", 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3920000000000003e-06 2024-09-14T07:13:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724960+0000", 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8599999999999998e-06 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725015+0000", 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5631999999999999e-05 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725096+0000", 2024-09-14T07:13:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0519999999999995e-05 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725197+0000", 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101277 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726820+0000", 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001622343 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728502+0000", 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682146 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728551+0000", 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9644000000000001e-05 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728593+0000", 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1430000000000001e-05 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103195 3.16 3:6f2974ce:::rbd_data.11823ead4c52.0000000000000005:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.472276399, 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036435819999999998, 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103195 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725219+0000", 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725244+0000", 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5142000000000001e-05 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725278+0000", 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4316999999999997e-05 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725306+0000", 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7392000000000001e-05 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725384+0000", 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8385000000000003e-05 2024-09-14T07:13:35.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725522+0000", 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013781199999999999 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725636+0000", 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011412399999999999 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726459+0000", 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082266499999999998 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728790+0000", 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023316029999999998 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728831+0000", 2024-09-14T07:13:35.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0329e-05 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728859+0000", 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8938999999999999e-05 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:103194 3.1f e101/85 3:fedd7d60:::rbd_data.11823ead4c52.0000000000000004:head v 101'539, mlcod=95'536)", 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.471262533000001, 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036764279999999998, 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.270 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:35.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.41e-07 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726234+0000", 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2189999999999998e-06 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726245+0000", 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0369e-05 2024-09-14T07:13:35.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726256+0000", 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1829e-05 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726404+0000", 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014722199999999999 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726425+0000", 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1605000000000001e-05 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729850+0000", 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003424739 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729906+0000", 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6203999999999999e-05 2024-09-14T07:13:35.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103209 3.c 3:36a1ae9e:::rbd_data.11823ead4c52.0000000000000017:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.466973138, 2024-09-14T07:13:35.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028727879999999998, 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103209 2024-09-14T07:13:35.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730521+0000", 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.795e-06 2024-09-14T07:13:35.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730527+0000", 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3589999999999996e-06 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730544+0000", 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6344000000000001e-05 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730553+0000", 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5810000000000003e-06 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730631+0000", 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8174000000000001e-05 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730760+0000", 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012861599999999999 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730877+0000", 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011691700000000001 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732342+0000", 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014650310000000001 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733287+0000", 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00094513599999999996 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733339+0000", 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2215000000000001e-05 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733392+0000", 2024-09-14T07:13:35.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2620000000000001e-05 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103218 3.1c 3:3e959835:::rbd_data.11823ead4c52.0000000000000033:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.465119651, 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033495629999999998, 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.286 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103218 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:35.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732374+0000", 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1540000000000001e-06 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732378+0000", 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3279999999999999e-06 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732390+0000", 2024-09-14T07:13:35.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1717e-05 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732395+0000", 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732451+0000", 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5093999999999998e-05 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732578+0000", 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127269 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732705+0000", 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127627 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735416+0000", 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027103299999999999 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735625+0000", 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000209101 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735680+0000", 2024-09-14T07:13:35.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5634000000000003e-05 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735722+0000", 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1695e-05 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3309 3.1f e105/85 3:f9a92dd7:::rbd_data.1182f9393092.00000000000000d1:13 v 105'545, mlcod=104'542)", 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4892640069999992, 2024-09-14T07:13:35.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052652389999999997, 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:35.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708229+0000", 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6499999999999998e-07 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708235+0000", 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-06 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708250+0000", 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4440999999999999e-05 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708257+0000", 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7209999999999997e-06 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708328+0000", 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1724000000000006e-05 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708349+0000", 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0424e-05 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713448+0000", 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050992950000000002 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713494+0000", 2024-09-14T07:13:35.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5509000000000001e-05 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(osd.5.0:303 3.d e105/98 ondisk, result = 0)", 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.4836300920000003, 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028738940000000001, 2024-09-14T07:13:35.297 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713863+0000", 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9100000000000003e-07 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713867+0000", 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2490000000000003e-06 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713886+0000", 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8791e-05 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713900+0000", 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3613e-05 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716720+0000", 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028207480000000001 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716726+0000", 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5600000000000001e-06 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716736+0000", 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0142e-05 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104289 3.1c 3:3852914e:::rbd_header.1182178f3240:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.5452990910000004, 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039485689999999999, 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.302 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104289 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652195+0000", 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000002e-06 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652205+0000", 2024-09-14T07:13:35.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7620000000000007e-06 2024-09-14T07:13:35.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652295+0000", 2024-09-14T07:13:35.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9728999999999994e-05 2024-09-14T07:13:35.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652308+0000", 2024-09-14T07:13:35.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2867999999999999e-05 2024-09-14T07:13:35.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652584+0000", 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027594400000000003 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:35.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652592+0000", 2024-09-14T07:13:35.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0579999999999998e-06 2024-09-14T07:13:35.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653791+0000", 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001199706 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653864+0000", 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2894999999999999e-05 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.654253+0000", 2024-09-14T07:13:35.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038851199999999998 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.655493+0000", 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001239995 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656020+0000", 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000526999 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656079+0000", 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8711000000000001e-05 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656142+0000", 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3171999999999998e-05 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104384 3.2 3:41c285d9:::rbd_data.1182178f3240.0000000000000194:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:35.311 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.4652240970000001, 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055148419999999998, 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104384 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732269+0000", 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0400000000000005e-07 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732273+0000", 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0640000000000004e-06 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732285+0000", 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1419e-05 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732290+0000", 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.366e-06 2024-09-14T07:13:35.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732366+0000", 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6144999999999997e-05 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732493+0000", 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126573 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732595+0000", 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102845 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733197+0000", 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060171300000000003 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737707+0000", 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045098689999999997 2024-09-14T07:13:35.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737755+0000", 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7596000000000003e-05 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737783+0000", 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8348e-05 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104385 3.16 3:6c6b45b7:::rbd_data.1182178f3240.0000000000000195:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 6.4651856539999999, 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004426269, 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104385 2024-09-14T07:13:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732310+0000", 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4370000000000001e-06 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732319+0000", 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2580000000000001e-06 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732324+0000", 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3929999999999999e-06 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732375+0000", 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0909000000000003e-05 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732449+0000", 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4173999999999998e-05 2024-09-14T07:13:35.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732509+0000", 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9630999999999999e-05 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733010+0000", 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050073999999999995 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736671+0000", 2024-09-14T07:13:35.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036615300000000001 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736703+0000", 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1287e-05 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736733+0000", 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0335e-05 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104553 3.1d 3:ba01ca6b:::rbd_data.11824d7f600c.0000000000000005:head [delete] snapc f=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 5.415066779, 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.947483572, 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104553 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:35.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782426+0000", 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2e-07 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782428+0000", 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2299999999999998e-06 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:35.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782435+0000", 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5200000000000003e-06 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782441+0000", 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.173e-06 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782489+0000", 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7692999999999999e-05 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782497+0000", 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2309999999999996e-06 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728308+0000", 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.94581115100000002 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728457+0000", 2024-09-14T07:13:35.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014953300000000001 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 2", 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728621+0000", 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016359 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729779+0000", 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011581880000000001 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729799+0000", 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0112999999999999e-05 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729855+0000", 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5513999999999997e-05 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729909+0000", 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4215999999999997e-05 2024-09-14T07:13:35.330 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:35.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:35.331 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:35.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:35.333 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:35.331+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:35.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:35.433 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:35.433+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:35.440 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:35.440 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:35.441 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:35.441 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:35.449 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:35.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:35.456 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:35.472 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:35.490 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:35.506 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:35.522 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:35.534 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:35.533+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:35.539 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:35.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:35.557 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:35.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:35.573 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:35.574 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:35.636 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:35.635+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:35.678 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:35.679 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:35.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:35.743 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T07:13:35.743 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:35.743+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:35.747 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:13:35.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T07:13:35.840 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:35.837+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:35.851 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:35.851 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:35.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:35.939 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:35.939+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:36.005 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.005 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:36.057 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:36.056+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:36.117 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.117 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:36.167 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:36.166+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:36.242 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:36.241+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:36.270 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.270 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.279 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:36.363 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:36.362+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:36.422 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.423 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:36.443 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:36.443+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:36.544 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:36.543+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:36.574 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.574 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:36.645 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:36.644+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:36.648 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T07:13:36.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T07:13:36.742 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.742 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.745 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:36.745+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:36.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:36.847 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:36.846+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:36.913 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:36.914 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:36.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:36.948 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:36.947+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:37.050 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:37.049+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:37.066 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:37.067 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:37.075 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:37.150 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:37.150+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:37.183 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:37.183 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:37.192 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:37.252 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:37.251+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:37.294 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:37.294 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:37.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:37.353 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:37.352+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:37.405 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:37.405 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:37.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:37.458 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:37.457+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:37.516 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:37.516 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:37.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:37.554 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:37.554+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:37.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:37.654 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:37.654+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:37.670 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:37.670 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:37.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:37.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:37.724 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:37.740 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:37.740 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T07:13:37.761 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:37.763 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:37.763+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:37.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T07:13:37.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T07:13:37.783 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:37.783 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:37.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:37.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:37.824 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:37.824 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:37.831 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:37.831 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:37.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 76.973244089000005, 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.832 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:37.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:37.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016773917999998, 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.839 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:37.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016763597999997, 2024-09-14T07:13:37.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:37.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:37.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016744621999997, 2024-09-14T07:13:37.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:37.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:37.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:37.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016733197000001, 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016721701000002, 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:37.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016710652, 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016700337000003, 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.868 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:37.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.016661083999999, 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.873 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:37.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:37.877 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.010766134000001, 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:37.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:37.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.010755367999998, 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.882 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:37.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:37.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:37.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.887 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.010745108999998, 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:37.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:37.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:37.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.010734403000001, 2024-09-14T07:13:37.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:37.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:37.898 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.010720636000002, 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:37.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:37.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:37.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:37.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:37.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:37.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.904 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.010710166000003, 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.905 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.906 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.906 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.906 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:37.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.906 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.004755007, 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.004744635000002, 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.916 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:37.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.004733708000003, 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:37.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 62.004724152999998, 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:37.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:37.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.686771460999999, 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:37.931 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:37.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:37.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:37.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:37.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:37.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:37.938 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:37.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:37.941 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:37.941 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:37.939+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:37.942 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:38.041 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:38.040+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:38.084 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:38.084 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:38.084 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:38.084 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:38.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:38.177 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:38.176+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:38.236 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:38.236 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:38.236 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:38.236 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:38.236 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:38.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:38.246 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:38.245+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:38.346 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:38.346+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:38.391 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:38.391 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:38.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:38.391 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:38.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.391 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 120.254791836, 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.392 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:38.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:38.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:38.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:38.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:38.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 95.699475313999997, 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.400 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:38.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:38.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479202416999996, 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.407 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:38.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479180725999996, 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.415 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:38.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.421 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479160823000001, 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:38.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:38.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:38.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:38.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479139329000006, 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.426 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:38.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479121008000007, 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:38.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:38.435 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479094665000005, 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479074199999999, 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.440 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:38.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:38.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:38.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:38.446 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.446 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.447 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.447 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:38.447 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479052344999999, 2024-09-14T07:13:38.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:38.448 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.448 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:38.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:38.453 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479033709999996, 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:38.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.479007569000004, 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.458 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.478980050999994, 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.463 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:38.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.478962572, 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.468 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:38.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.478950456000007, 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.472 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.473508437999996, 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:38.477 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.473489114000003, 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.482 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:38.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.473460263999996, 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:38.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:38.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.473419739999997, 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.492 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:38.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:38.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 81.473397715000004, 2024-09-14T07:13:38.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:38.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:38.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.503 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.503 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:38.504 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:38.505 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:38.504+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:38.605 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:38.604+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:38.608 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:38.608 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:38.609 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:38.609 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:38.617 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:38.706 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:38.705+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:38.760 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:38.760 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:38.760 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:38.761 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T07:13:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-09-14T07:13:38.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:38.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T07:13:38.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:13:38.831 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:38.830+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:38.907 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:38.907+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:38.919 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101015 3.5 3:a64521d3:::rbd_data.11821cead9c1.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.081382257999998, 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043484730000000003, 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.920 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101015 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836623+0000", 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-07 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836627+0000", 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836636+0000", 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9449999999999999e-06 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836642+0000", 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2449999999999998e-06 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836695+0000", 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3735e-05 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836826+0000", 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013094300000000001 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836939+0000", 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112557 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838008+0000", 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001068989 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840911+0000", 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029033010000000001 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840943+0000", 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1738e-05 2024-09-14T07:13:38.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840971+0000", 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7885000000000002e-05 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3046 3.1f e87/85 3:ffa53dc0:::rbd_data.118239a42b07.0000000000000006:22 v 87'521, mlcod=86'518)", 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.117043471999999, 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045671549999999998, 2024-09-14T07:13:38.926 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800967+0000", 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8669999999999999e-06 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800992+0000", 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4555000000000001e-05 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801048+0000", 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6093e-05 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801219+0000", 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017133599999999999 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801245+0000", 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5439000000000002e-05 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805483+0000", 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042387969999999999 2024-09-14T07:13:38.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805528+0000", 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4676999999999999e-05 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3047 3.17 e87/85 3:ea926012:::rbd_data.118239a42b07.000000000000000e:22 v 87'627, mlcod=84'624)", 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.113775091000001, 2024-09-14T07:13:38.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037476889999999998, 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804230+0000", 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804239+0000", 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9269999999999994e-06 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804252+0000", 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2679e-05 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804261+0000", 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7239999999999998e-06 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804348+0000", 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7134999999999998e-05 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804374+0000", 2024-09-14T07:13:38.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6288e-05 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807887+0000", 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035127589999999998 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807977+0000", 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0101999999999999e-05 2024-09-14T07:13:38.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101670 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.100750209000001, 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040111699999999997, 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.937 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101670 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817256+0000", 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7e-06 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817265+0000", 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1989999999999995e-06 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817280+0000", 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4952e-05 2024-09-14T07:13:38.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817288+0000", 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6879999999999999e-06 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817356+0000", 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7979999999999996e-05 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817365+0000", 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2450000000000004e-06 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819318+0000", 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019528499999999999 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819415+0000", 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7578999999999995e-05 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819804+0000", 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038904400000000001 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821059+0000", 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001254523 2024-09-14T07:13:38.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821156+0000", 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6824999999999995e-05 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821227+0000", 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1013000000000006e-05 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821265+0000", 2024-09-14T07:13:38.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8572000000000003e-05 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101676 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [watch unwatch cookie 140170150085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.090046615999999, 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041592649999999997, 2024-09-14T07:13:38.944 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101676 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827961+0000", 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7769999999999998e-06 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827969+0000", 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827975+0000", 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1e-06 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828225+0000", 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024990199999999998 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828309+0000", 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3647999999999996e-05 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828455+0000", 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657200000000001 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829183+0000", 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072760100000000003 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831875+0000", 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026923089999999999 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831958+0000", 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2164999999999997e-05 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832117+0000", 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159562 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101677 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.089739702999999, 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039841629999999998, 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.951 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101677 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828266+0000", 2024-09-14T07:13:38.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.001e-06 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828271+0000", 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828282+0000", 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0868e-05 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828302+0000", 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0245e-05 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828984+0000", 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068168600000000003 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829038+0000", 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3732e-05 2024-09-14T07:13:38.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832153+0000", 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031149929999999999 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832195+0000", 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1853000000000001e-05 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832249+0000", 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4398999999999999e-05 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101893 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.091945019000001, 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003596237, 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.957 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101893 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826062+0000", 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1289999999999999e-06 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826071+0000", 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0310000000000004e-06 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826093+0000", 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2659000000000001e-05 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826104+0000", 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0379e-05 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826226+0000", 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012198500000000001 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826232+0000", 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.533e-06 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.827997+0000", 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017645689999999999 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828088+0000", 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1317999999999995e-05 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828266+0000", 2024-09-14T07:13:38.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178102 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829260+0000", 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099377699999999994 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829563+0000", 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030319599999999999 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829617+0000", 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3384000000000003e-05 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829656+0000", 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9174999999999997e-05 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101988 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 27.019846259000001, 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059469579999999996, 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101988 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.965 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898159+0000", 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1900000000000001e-07 2024-09-14T07:13:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898163+0000", 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.675e-06 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898170+0000", 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898174+0000", 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1409999999999998e-06 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898209+0000", 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4301000000000002e-05 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898262+0000", 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3282999999999998e-05 2024-09-14T07:13:38.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898477+0000", 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214606 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.899294+0000", 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081715499999999996 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904020+0000", 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047267430000000003 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904058+0000", 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7842000000000001e-05 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904105+0000", 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6864999999999999e-05 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.970 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102779 3.5 3:a1624695:::rbd_object_map.1182fc4f94db:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.255141829999999, 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041172270000000002, 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.971 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102779 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662864+0000", 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.578e-06 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662871+0000", 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8210000000000004e-06 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662884+0000", 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.324e-05 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662900+0000", 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526999999999999e-05 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662966+0000", 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6024000000000003e-05 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663058+0000", 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1861999999999996e-05 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663178+0000", 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012068199999999999 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663663+0000", 2024-09-14T07:13:38.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048430700000000001 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666909+0000", 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032459440000000002 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666944+0000", 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5748999999999999e-05 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666980+0000", 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5493000000000001e-05 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102872 3.1c 3:3cb8b5e3:::rbd_data.1182fc4f94db.0000000000000011:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.193065682, 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036539760000000002, 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102872 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.978 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2300000000000001e-07 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724946+0000", 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1090000000000003e-06 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724954+0000", 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3920000000000003e-06 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724960+0000", 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8599999999999998e-06 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725015+0000", 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5631999999999999e-05 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725096+0000", 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0519999999999995e-05 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725197+0000", 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101277 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726820+0000", 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001622343 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728502+0000", 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682146 2024-09-14T07:13:38.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728551+0000", 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9644000000000001e-05 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728593+0000", 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1430000000000001e-05 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103195 3.16 3:6f2974ce:::rbd_data.11823ead4c52.0000000000000005:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.192788586999999, 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036435819999999998, 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103195 2024-09-14T07:13:38.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725219+0000", 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725244+0000", 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5142000000000001e-05 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725278+0000", 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4316999999999997e-05 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725306+0000", 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7392000000000001e-05 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725384+0000", 2024-09-14T07:13:38.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8385000000000003e-05 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725522+0000", 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013781199999999999 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725636+0000", 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011412399999999999 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726459+0000", 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082266499999999998 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728790+0000", 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023316029999999998 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728831+0000", 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0329e-05 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728859+0000", 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8938999999999999e-05 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:103194 3.1f e101/85 3:fedd7d60:::rbd_data.11823ead4c52.0000000000000004:head v 101'539, mlcod=95'536)", 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.191774721000002, 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036764279999999998, 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.41e-07 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726234+0000", 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2189999999999998e-06 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726245+0000", 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0369e-05 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726256+0000", 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1829e-05 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:38.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726404+0000", 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014722199999999999 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726425+0000", 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1605000000000001e-05 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729850+0000", 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003424739 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729906+0000", 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6203999999999999e-05 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103209 3.c 3:36a1ae9e:::rbd_data.11823ead4c52.0000000000000017:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.187485326000001, 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028727879999999998, 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103209 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:38.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:38.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:38.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:38.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:38.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730521+0000", 2024-09-14T07:13:38.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.795e-06 2024-09-14T07:13:38.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730527+0000", 2024-09-14T07:13:39.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3589999999999996e-06 2024-09-14T07:13:39.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730544+0000", 2024-09-14T07:13:39.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6344000000000001e-05 2024-09-14T07:13:39.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730553+0000", 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5810000000000003e-06 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730631+0000", 2024-09-14T07:13:39.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8174000000000001e-05 2024-09-14T07:13:39.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730760+0000", 2024-09-14T07:13:39.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012861599999999999 2024-09-14T07:13:39.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:39.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730877+0000", 2024-09-14T07:13:39.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011691700000000001 2024-09-14T07:13:39.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732342+0000", 2024-09-14T07:13:39.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014650310000000001 2024-09-14T07:13:39.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:39.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733287+0000", 2024-09-14T07:13:39.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00094513599999999996 2024-09-14T07:13:39.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733339+0000", 2024-09-14T07:13:39.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2215000000000001e-05 2024-09-14T07:13:39.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733392+0000", 2024-09-14T07:13:39.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2620000000000001e-05 2024-09-14T07:13:39.008 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.008 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.009 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.009 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103218 3.1c 3:3e959835:::rbd_data.11823ead4c52.0000000000000033:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:39.009 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:39.010 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.185631838999999, 2024-09-14T07:13:39.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033495629999999998, 2024-09-14T07:13:39.010 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.010 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.010 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.011 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:39.011 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:39.011 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.011 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103218 2024-09-14T07:13:39.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.011 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:39.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:39.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.014 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732374+0000", 2024-09-14T07:13:39.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1540000000000001e-06 2024-09-14T07:13:39.014 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.015 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.015 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732378+0000", 2024-09-14T07:13:39.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3279999999999999e-06 2024-09-14T07:13:39.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732390+0000", 2024-09-14T07:13:39.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1717e-05 2024-09-14T07:13:39.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732395+0000", 2024-09-14T07:13:39.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:13:39.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732451+0000", 2024-09-14T07:13:39.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5093999999999998e-05 2024-09-14T07:13:39.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732578+0000", 2024-09-14T07:13:39.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127269 2024-09-14T07:13:39.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:39.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732705+0000", 2024-09-14T07:13:39.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127627 2024-09-14T07:13:39.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:39.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735416+0000", 2024-09-14T07:13:39.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027103299999999999 2024-09-14T07:13:39.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.021 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735625+0000", 2024-09-14T07:13:39.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000209101 2024-09-14T07:13:39.022 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735680+0000", 2024-09-14T07:13:39.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5634000000000003e-05 2024-09-14T07:13:39.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735722+0000", 2024-09-14T07:13:39.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1695e-05 2024-09-14T07:13:39.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.024 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.025 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3309 3.1f e105/85 3:f9a92dd7:::rbd_data.1182f9393092.00000000000000d1:13 v 105'545, mlcod=104'542)", 2024-09-14T07:13:39.025 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:39.025 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.209776195, 2024-09-14T07:13:39.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052652389999999997, 2024-09-14T07:13:39.025 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.025 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.026 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.026 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:39.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:39.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.028 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708229+0000", 2024-09-14T07:13:39.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6499999999999998e-07 2024-09-14T07:13:39.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708235+0000", 2024-09-14T07:13:39.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-06 2024-09-14T07:13:39.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708250+0000", 2024-09-14T07:13:39.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4440999999999999e-05 2024-09-14T07:13:39.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708257+0000", 2024-09-14T07:13:39.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7209999999999997e-06 2024-09-14T07:13:39.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708328+0000", 2024-09-14T07:13:39.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1724000000000006e-05 2024-09-14T07:13:39.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708349+0000", 2024-09-14T07:13:39.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0424e-05 2024-09-14T07:13:39.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713448+0000", 2024-09-14T07:13:39.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050992950000000002 2024-09-14T07:13:39.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.035 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713494+0000", 2024-09-14T07:13:39.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5509000000000001e-05 2024-09-14T07:13:39.035 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.035 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.035 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.035 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.036 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(osd.5.0:303 3.d e105/98 ondisk, result = 0)", 2024-09-14T07:13:39.036 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:39.036 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.204142279999999, 2024-09-14T07:13:39.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028738940000000001, 2024-09-14T07:13:39.037 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.037 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.037 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:39.037 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:39.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713863+0000", 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9100000000000003e-07 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713867+0000", 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2490000000000003e-06 2024-09-14T07:13:39.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713886+0000", 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8791e-05 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713900+0000", 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3613e-05 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.040 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716720+0000", 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028207480000000001 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716726+0000", 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5600000000000001e-06 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716736+0000", 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0142e-05 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.041 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104289 3.1c 3:3852914e:::rbd_header.1182178f3240:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.265811278999999, 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039485689999999999, 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104289 2024-09-14T07:13:39.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652195+0000", 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000002e-06 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652205+0000", 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7620000000000007e-06 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652295+0000", 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9728999999999994e-05 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652308+0000", 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2867999999999999e-05 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652584+0000", 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027594400000000003 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652592+0000", 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0579999999999998e-06 2024-09-14T07:13:39.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653791+0000", 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001199706 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653864+0000", 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2894999999999999e-05 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.654253+0000", 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038851199999999998 2024-09-14T07:13:39.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.655493+0000", 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001239995 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656020+0000", 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000526999 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656079+0000", 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8711000000000001e-05 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656142+0000", 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3171999999999998e-05 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.048 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104384 3.2 3:41c285d9:::rbd_data.1182178f3240.0000000000000194:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.185736285000001, 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055148419999999998, 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104384 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732269+0000", 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0400000000000005e-07 2024-09-14T07:13:39.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732273+0000", 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0640000000000004e-06 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732285+0000", 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1419e-05 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732290+0000", 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.366e-06 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732366+0000", 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6144999999999997e-05 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732493+0000", 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126573 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732595+0000", 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102845 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733197+0000", 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060171300000000003 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737707+0000", 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045098689999999997 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737755+0000", 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7596000000000003e-05 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737783+0000", 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8348e-05 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.054 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104385 3.16 3:6c6b45b7:::rbd_data.1182178f3240.0000000000000195:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 10.185697842, 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004426269, 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:39.055 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104385 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:39.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732310+0000", 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4370000000000001e-06 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732319+0000", 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2580000000000001e-06 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732324+0000", 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3929999999999999e-06 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732375+0000", 2024-09-14T07:13:39.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0909000000000003e-05 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732449+0000", 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4173999999999998e-05 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732509+0000", 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9630999999999999e-05 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:39.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733010+0000", 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050073999999999995 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736671+0000", 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036615300000000001 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736703+0000", 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1287e-05 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736733+0000", 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0335e-05 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104553 3.1d 3:ba01ca6b:::rbd_data.11824d7f600c.0000000000000005:head [delete] snapc f=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 9.1355789670000007, 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.947483572, 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:39.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104553 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:39.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782426+0000", 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2e-07 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782428+0000", 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2299999999999998e-06 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:39.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782435+0000", 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5200000000000003e-06 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782441+0000", 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.173e-06 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782489+0000", 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7692999999999999e-05 2024-09-14T07:13:39.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782497+0000", 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2309999999999996e-06 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728308+0000", 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.94581115100000002 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:39.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728457+0000", 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014953300000000001 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 2", 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728621+0000", 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016359 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729779+0000", 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011581880000000001 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729799+0000", 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0112999999999999e-05 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729855+0000", 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5513999999999997e-05 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729909+0000", 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4215999999999997e-05 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.067 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:39.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:39.068 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:39.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:39.070 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:39.068+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:39.122 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:39.122 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:13:39.135 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-14T07:13:38.760502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":297164305,"num_objects":346,"num_object_clones":96,"num_object_copies":692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":147,"num_read":144960,"num_read_kb":755616,"num_write":17866,"num_write_kb":402763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1467,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15395,"ondisk_log_size":15395,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":346524,"kb_used_data":67344,"kb_used_omap":18,"kb_used_meta":277869,"kb_avail":660256356,"statfs":{"total":676457349120,"available":676102508544,"internally_reserved":0,"allocated":68960256,"data_stored":95809246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19159,"internal_metadata":284538153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-148119589,"num_objects":-82,"num_object_clones":-18,"num_object_copies":-164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-82,"num_whiteouts":-15,"num_read":1733,"num_read_kb":1474,"num_write":212,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.023534"},"pg_stats":[{"pgid":"3.1f","version":"112'564","reported_seq":4509,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.769695+0000","last_change":"2024-09-14T07:13:34.770278+0000","last_active":"2024-09-14T07:13:34.769695+0000","last_peered":"2024-09-14T07:13:34.769695+0000","last_clean":"2024-09-14T07:13:34.769695+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:13:34.769695+0000","last_undegraded":"2024-09-14T07:13:34.769695+0000","last_fullsized":"2024-09-14T07:13:34.769695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.516180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020014540000000002,"stat_sum":{"num_bytes":5710776,"num_objects":19,"num_object_clones":7,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":5889,"num_read_kb":30099,"num_write":687,"num_write_kb":17798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.1e","version":"112'296","reported_seq":4364,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740904+0000","last_change":"2024-09-14T07:13:34.741151+0000","last_active":"2024-09-14T07:13:34.740904+0000","last_peered":"2024-09-14T07:13:34.740904+0000","last_clean":"2024-09-14T07:13:34.740904+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:13:34.740904+0000","last_undegraded":"2024-09-14T07:13:34.740904+0000","last_fullsized":"2024-09-14T07:13:34.740904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:33.152085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050951999999999996,"stat_sum":{"num_bytes":2642710,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":4,"num_read":3833,"num_read_kb":18608,"num_write":285,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.1d","version":"110'235","reported_seq":2141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.663023+0000","last_change":"2024-09-14T07:13:36.663455+0000","last_active":"2024-09-14T07:13:36.663023+0000","last_peered":"2024-09-14T07:13:36.663023+0000","last_clean":"2024-09-14T07:13:36.663023+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:13:36.663023+0000","last_undegraded":"2024-09-14T07:13:36.663023+0000","last_fullsized":"2024-09-14T07:13:36.663023+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:30.585692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040105160000000004,"stat_sum":{"num_bytes":9441332,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":6,"num_read":1436,"num_read_kb":8957,"num_write":224,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.1c","version":"116'551","reported_seq":2374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.711415+0000","last_change":"2024-09-14T07:13:36.663548+0000","last_active":"2024-09-14T07:13:36.711415+0000","last_peered":"2024-09-14T07:13:36.711415+0000","last_clean":"2024-09-14T07:13:36.711415+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:13:36.711415+0000","last_undegraded":"2024-09-14T07:13:36.711415+0000","last_fullsized":"2024-09-14T07:13:36.711415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:30:58.069381+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0047619239999999998,"stat_sum":{"num_bytes":21766144,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":2759,"num_read_kb":13621,"num_write":640,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.1b","version":"113'273","reported_seq":2856,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.769083+0000","last_change":"2024-09-14T07:13:34.769320+0000","last_active":"2024-09-14T07:13:34.769083+0000","last_peered":"2024-09-14T07:13:34.769083+0000","last_clean":"2024-09-14T07:13:34.769083+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:13:34.769083+0000","last_undegraded":"2024-09-14T07:13:34.769083+0000","last_fullsized":"2024-09-14T07:13:34.769083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:43.547275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001519545,"stat_sum":{"num_bytes":1213357,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":2546,"num_read_kb":18886,"num_write":297,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.1a","version":"113'687","reported_seq":3683,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.855046+0000","last_change":"2024-09-14T07:13:34.738857+0000","last_active":"2024-09-14T07:13:34.855046+0000","last_peered":"2024-09-14T07:13:34.855046+0000","last_clean":"2024-09-14T07:13:34.855046+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:13:34.855046+0000","last_undegraded":"2024-09-14T07:13:34.855046+0000","last_fullsized":"2024-09-14T07:13:34.855046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:19.384991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063855900000000002,"stat_sum":{"num_bytes":4943718,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":4963,"num_read_kb":28073,"num_write":1012,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.19","version":"112'367","reported_seq":5205,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738490+0000","last_change":"2024-09-14T07:13:34.738792+0000","last_active":"2024-09-14T07:13:34.738490+0000","last_peered":"2024-09-14T07:13:34.738490+0000","last_clean":"2024-09-14T07:13:34.738490+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:13:34.738490+0000","last_undegraded":"2024-09-14T07:13:34.738490+0000","last_fullsized":"2024-09-14T07:13:34.738490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:32.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054646700000000002,"stat_sum":{"num_bytes":6185803,"num_objects":13,"num_object_clones":1,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":9,"num_read":5049,"num_read_kb":21159,"num_write":433,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.18","version":"112'445","reported_seq":2909,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.768416+0000","last_change":"2024-09-14T07:13:34.768747+0000","last_active":"2024-09-14T07:13:34.768416+0000","last_peered":"2024-09-14T07:13:34.768416+0000","last_clean":"2024-09-14T07:13:34.768416+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:13:34.768416+0000","last_undegraded":"2024-09-14T07:13:34.768416+0000","last_fullsized":"2024-09-14T07:13:34.768416+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:07.449517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030605,"stat_sum":{"num_bytes":524288,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":498,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.17","version":"113'704","reported_seq":8213,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.770262+0000","last_change":"2024-09-14T07:13:34.770478+0000","last_active":"2024-09-14T07:13:34.770262+0000","last_peered":"2024-09-14T07:13:34.770262+0000","last_clean":"2024-09-14T07:13:34.770262+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:13:34.770262+0000","last_undegraded":"2024-09-14T07:13:34.770262+0000","last_fullsized":"2024-09-14T07:13:34.770262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:51.442318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021107069999999999,"stat_sum":{"num_bytes":10571519,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":4,"num_read":10069,"num_read_kb":40986,"num_write":868,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.16","version":"115'469","reported_seq":2621,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.659184+0000","last_change":"2024-09-14T07:13:36.660100+0000","last_active":"2024-09-14T07:13:36.659184+0000","last_peered":"2024-09-14T07:13:36.659184+0000","last_clean":"2024-09-14T07:13:36.659184+0000","last_became_active":"2024-09-14T07:13:19.656544+0000","last_became_peered":"2024-09-14T07:13:19.656544+0000","last_unstale":"2024-09-14T07:13:36.659184+0000","last_undegraded":"2024-09-14T07:13:36.659184+0000","last_fullsized":"2024-09-14T07:13:36.659184+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.119782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014386679999999999,"stat_sum":{"num_bytes":5071343,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":3216,"num_read_kb":8610,"num_write":599,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.15","version":"114'358","reported_seq":1548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.868777+0000","last_change":"2024-09-14T07:13:34.745916+0000","last_active":"2024-09-14T07:13:34.868777+0000","last_peered":"2024-09-14T07:13:34.868777+0000","last_clean":"2024-09-14T07:13:34.868777+0000","last_became_active":"2024-09-14T07:13:19.654331+0000","last_became_peered":"2024-09-14T07:13:19.654331+0000","last_unstale":"2024-09-14T07:13:34.868777+0000","last_undegraded":"2024-09-14T07:13:34.868777+0000","last_fullsized":"2024-09-14T07:13:34.868777+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:28:11.443920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013458750000000001,"stat_sum":{"num_bytes":352534,"num_objects":9,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":1525,"num_read_kb":15257,"num_write":405,"num_write_kb":9295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.14","version":"107'758","reported_seq":3889,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.739732+0000","last_change":"2024-09-14T07:13:34.739732+0000","last_active":"2024-09-14T07:13:34.739732+0000","last_peered":"2024-09-14T07:13:34.739732+0000","last_clean":"2024-09-14T07:13:34.739732+0000","last_became_active":"2024-09-14T07:13:19.654127+0000","last_became_peered":"2024-09-14T07:13:19.654127+0000","last_unstale":"2024-09-14T07:13:34.739732+0000","last_undegraded":"2024-09-14T07:13:34.739732+0000","last_fullsized":"2024-09-14T07:13:34.739732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:54.150491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014224109999999999,"stat_sum":{"num_bytes":262275,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":5476,"num_read_kb":29545,"num_write":1141,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740542+0000","last_change":"2024-09-14T07:13:16.651496+0000","last_active":"2024-09-14T07:13:34.740542+0000","last_peered":"2024-09-14T07:13:34.740542+0000","last_clean":"2024-09-14T07:13:34.740542+0000","last_became_active":"2024-09-14T07:13:16.651181+0000","last_became_peered":"2024-09-14T07:13:16.651181+0000","last_unstale":"2024-09-14T07:13:34.740542+0000","last_undegraded":"2024-09-14T07:13:34.740542+0000","last_fullsized":"2024-09-14T07:13:34.740542+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:18.912983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"114'869","reported_seq":4415,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.819282+0000","last_change":"2024-09-14T07:13:34.769035+0000","last_active":"2024-09-14T07:13:34.819282+0000","last_peered":"2024-09-14T07:13:34.819282+0000","last_clean":"2024-09-14T07:13:34.819282+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:13:34.819282+0000","last_undegraded":"2024-09-14T07:13:34.819282+0000","last_fullsized":"2024-09-14T07:13:34.819282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:09.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012558070000000001,"stat_sum":{"num_bytes":4945207,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":5,"num_read":7262,"num_read_kb":29510,"num_write":989,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.6","version":"0'0","reported_seq":204,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738455+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:13:34.738455+0000","last_peered":"2024-09-14T07:13:34.738455+0000","last_clean":"2024-09-14T07:13:34.738455+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:13:34.738455+0000","last_undegraded":"2024-09-14T07:13:34.738455+0000","last_fullsized":"2024-09-14T07:13:34.738455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5036,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.769399+0000","last_change":"2024-09-14T07:13:34.769711+0000","last_active":"2024-09-14T07:13:34.769399+0000","last_peered":"2024-09-14T07:13:34.769399+0000","last_clean":"2024-09-14T07:13:34.769399+0000","last_became_active":"2024-09-14T07:13:19.656177+0000","last_became_peered":"2024-09-14T07:13:19.656177+0000","last_unstale":"2024-09-14T07:13:34.769399+0000","last_undegraded":"2024-09-14T07:13:34.769399+0000","last_fullsized":"2024-09-14T07:13:34.769399+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:19.611764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015409270000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.767574+0000","last_change":"2024-09-14T07:13:16.653004+0000","last_active":"2024-09-14T07:13:34.767574+0000","last_peered":"2024-09-14T07:13:34.767574+0000","last_clean":"2024-09-14T07:13:34.767574+0000","last_became_active":"2024-09-14T07:13:16.652678+0000","last_became_peered":"2024-09-14T07:13:16.652678+0000","last_unstale":"2024-09-14T07:13:34.767574+0000","last_undegraded":"2024-09-14T07:13:34.767574+0000","last_fullsized":"2024-09-14T07:13:34.767574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:09.278008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"108'947","reported_seq":5004,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.841394+0000","last_change":"2024-09-14T07:13:34.739208+0000","last_active":"2024-09-14T07:13:34.841394+0000","last_peered":"2024-09-14T07:13:34.841394+0000","last_clean":"2024-09-14T07:13:34.841394+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:13:34.841394+0000","last_undegraded":"2024-09-14T07:13:34.841394+0000","last_fullsized":"2024-09-14T07:13:34.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:47.880932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000746501,"stat_sum":{"num_bytes":7960760,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":6,"num_read":8849,"num_read_kb":23076,"num_write":1254,"num_write_kb":11182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.4","version":"0'0","reported_seq":204,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738672+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:13:34.738672+0000","last_peered":"2024-09-14T07:13:34.738672+0000","last_clean":"2024-09-14T07:13:34.738672+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:13:34.738672+0000","last_undegraded":"2024-09-14T07:13:34.738672+0000","last_fullsized":"2024-09-14T07:13:34.738672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'539","reported_seq":1374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.662983+0000","last_change":"2024-09-14T07:13:36.662983+0000","last_active":"2024-09-14T07:13:36.662983+0000","last_peered":"2024-09-14T07:13:36.662983+0000","last_clean":"2024-09-14T07:13:36.662983+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:13:36.662983+0000","last_undegraded":"2024-09-14T07:13:36.662983+0000","last_fullsized":"2024-09-14T07:13:36.662983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:43.979916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036732679999999999,"stat_sum":{"num_bytes":13883038,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":10,"num_read":2000,"num_read_kb":11530,"num_write":723,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.3","version":"114'447","reported_seq":2806,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.820760+0000","last_change":"2024-09-14T07:13:34.741323+0000","last_active":"2024-09-14T07:13:34.820760+0000","last_peered":"2024-09-14T07:13:34.820760+0000","last_clean":"2024-09-14T07:13:34.820760+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:13:34.820760+0000","last_undegraded":"2024-09-14T07:13:34.820760+0000","last_fullsized":"2024-09-14T07:13:34.820760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:21.926323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026316239999999999,"stat_sum":{"num_bytes":655445,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":2279,"num_read_kb":22380,"num_write":503,"num_write_kb":19069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.2","version":"22'2","reported_seq":106,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.658404+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:13:36.658404+0000","last_peered":"2024-09-14T07:13:36.658404+0000","last_clean":"2024-09-14T07:13:36.658404+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:13:36.658404+0000","last_undegraded":"2024-09-14T07:13:36.658404+0000","last_fullsized":"2024-09-14T07:13:36.658404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"114'288","reported_seq":4345,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.814968+0000","last_change":"2024-09-14T07:13:34.739055+0000","last_active":"2024-09-14T07:13:34.814968+0000","last_peered":"2024-09-14T07:13:34.814968+0000","last_clean":"2024-09-14T07:13:34.814968+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:13:34.814968+0000","last_undegraded":"2024-09-14T07:13:34.814968+0000","last_fullsized":"2024-09-14T07:13:34.814968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:26.037541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067425500000000001,"stat_sum":{"num_bytes":26782463,"num_objects":15,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":6,"num_read":4228,"num_read_kb":27994,"num_write":255,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738532+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:13:34.738532+0000","last_peered":"2024-09-14T07:13:34.738532+0000","last_clean":"2024-09-14T07:13:34.738532+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:13:34.738532+0000","last_undegraded":"2024-09-14T07:13:34.738532+0000","last_fullsized":"2024-09-14T07:13:34.738532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"113'277","reported_seq":3405,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.767851+0000","last_change":"2024-09-14T07:13:34.768346+0000","last_active":"2024-09-14T07:13:34.767851+0000","last_peered":"2024-09-14T07:13:34.767851+0000","last_clean":"2024-09-14T07:13:34.767851+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:13:34.767851+0000","last_undegraded":"2024-09-14T07:13:34.767851+0000","last_fullsized":"2024-09-14T07:13:34.767851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:03.976991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074572099999999997,"stat_sum":{"num_bytes":5592406,"num_objects":8,"num_object_clones":4,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":3291,"num_read_kb":29044,"num_write":290,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738635+0000","last_change":"2024-09-14T07:13:16.651234+0000","last_active":"2024-09-14T07:13:34.738635+0000","last_peered":"2024-09-14T07:13:34.738635+0000","last_clean":"2024-09-14T07:13:34.738635+0000","last_became_active":"2024-09-14T07:13:16.650850+0000","last_became_peered":"2024-09-14T07:13:16.650850+0000","last_unstale":"2024-09-14T07:13:34.738635+0000","last_undegraded":"2024-09-14T07:13:34.738635+0000","last_fullsized":"2024-09-14T07:13:34.738635+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:14.413583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"115'327","reported_seq":1858,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.661218+0000","last_change":"2024-09-14T07:13:36.662317+0000","last_active":"2024-09-14T07:13:36.661218+0000","last_peered":"2024-09-14T07:13:36.661218+0000","last_clean":"2024-09-14T07:13:36.661218+0000","last_became_active":"2024-09-14T07:13:06.770031+0000","last_became_peered":"2024-09-14T07:13:06.770031+0000","last_unstale":"2024-09-14T07:13:36.661218+0000","last_undegraded":"2024-09-14T07:13:36.661218+0000","last_fullsized":"2024-09-14T07:13:36.661218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:46.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032200150000000001,"stat_sum":{"num_bytes":7610384,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":4,"num_read":1639,"num_read_kb":10884,"num_write":367,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"2.3","version":"20'1","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.658532+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:13:36.658532+0000","last_peered":"2024-09-14T07:13:36.658532+0000","last_clean":"2024-09-14T07:13:36.658532+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:13:36.658532+0000","last_undegraded":"2024-09-14T07:13:36.658532+0000","last_fullsized":"2024-09-14T07:13:36.658532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":257,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.767628+0000","last_change":"2024-09-14T07:13:16.660568+0000","last_active":"2024-09-14T07:13:34.767628+0000","last_peered":"2024-09-14T07:13:34.767628+0000","last_clean":"2024-09-14T07:13:34.767628+0000","last_became_active":"2024-09-14T07:13:16.654563+0000","last_became_peered":"2024-09-14T07:13:16.654563+0000","last_unstale":"2024-09-14T07:13:34.767628+0000","last_undegraded":"2024-09-14T07:13:34.767628+0000","last_fullsized":"2024-09-14T07:13:34.767628+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:51.382437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"109'422","reported_seq":3198,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.855417+0000","last_change":"2024-09-14T07:13:34.744896+0000","last_active":"2024-09-14T07:13:34.855417+0000","last_peered":"2024-09-14T07:13:34.855417+0000","last_clean":"2024-09-14T07:13:34.855417+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:13:34.855417+0000","last_undegraded":"2024-09-14T07:13:34.855417+0000","last_fullsized":"2024-09-14T07:13:34.855417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:57.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058675000000000003,"stat_sum":{"num_bytes":11873230,"num_objects":20,"num_object_clones":7,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":4584,"num_read_kb":17835,"num_write":490,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.9","version":"114'520","reported_seq":4366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.871001+0000","last_change":"2024-09-14T07:13:34.739193+0000","last_active":"2024-09-14T07:13:34.871001+0000","last_peered":"2024-09-14T07:13:34.871001+0000","last_clean":"2024-09-14T07:13:34.871001+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:13:34.871001+0000","last_undegraded":"2024-09-14T07:13:34.871001+0000","last_fullsized":"2024-09-14T07:13:34.871001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:42.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092687800000000001,"stat_sum":{"num_bytes":4637997,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":6,"num_read":6457,"num_read_kb":37218,"num_write":486,"num_write_kb":19491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.a","version":"114'398","reported_seq":2202,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.741172+0000","last_change":"2024-09-14T07:13:34.741172+0000","last_active":"2024-09-14T07:13:34.741172+0000","last_peered":"2024-09-14T07:13:34.741172+0000","last_clean":"2024-09-14T07:13:34.741172+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:13:34.741172+0000","last_undegraded":"2024-09-14T07:13:34.741172+0000","last_fullsized":"2024-09-14T07:13:34.741172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:02.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000489767,"stat_sum":{"num_bytes":19088274,"num_objects":12,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":1966,"num_read_kb":55184,"num_write":437,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.b","version":"113'289","reported_seq":2700,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.823510+0000","last_change":"2024-09-14T07:13:34.768701+0000","last_active":"2024-09-14T07:13:34.823510+0000","last_peered":"2024-09-14T07:13:34.823510+0000","last_clean":"2024-09-14T07:13:34.823510+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:13:34.823510+0000","last_undegraded":"2024-09-14T07:13:34.823510+0000","last_fullsized":"2024-09-14T07:13:34.823510+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:05.591605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010133410000000001,"stat_sum":{"num_bytes":46651803,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":6,"num_read":2121,"num_read_kb":21711,"num_write":279,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.c","version":"109'740","reported_seq":6288,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.660194+0000","last_change":"2024-09-14T07:13:36.661158+0000","last_active":"2024-09-14T07:13:36.660194+0000","last_peered":"2024-09-14T07:13:36.660194+0000","last_clean":"2024-09-14T07:13:36.660194+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:13:36.660194+0000","last_undegraded":"2024-09-14T07:13:36.660194+0000","last_fullsized":"2024-09-14T07:13:36.660194+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:41.354212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020943340000000002,"stat_sum":{"num_bytes":7253527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":961,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.d","version":"116'691","reported_seq":7211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.665513+0000","last_change":"2024-09-14T07:13:36.665839+0000","last_active":"2024-09-14T07:13:36.665513+0000","last_peered":"2024-09-14T07:13:36.665513+0000","last_clean":"2024-09-14T07:13:36.665513+0000","last_became_active":"2024-09-14T07:13:19.658169+0000","last_became_peered":"2024-09-14T07:13:19.658169+0000","last_unstale":"2024-09-14T07:13:36.665513+0000","last_undegraded":"2024-09-14T07:13:36.665513+0000","last_fullsized":"2024-09-14T07:13:36.665513+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:43.882757+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0058405610000000002,"stat_sum":{"num_bytes":6815866,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":5,"num_read":10232,"num_read_kb":25446,"num_write":677,"num_write_kb":3827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.e","version":"109'218","reported_seq":2641,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740365+0000","last_change":"2024-09-14T07:13:34.740688+0000","last_active":"2024-09-14T07:13:34.740365+0000","last_peered":"2024-09-14T07:13:34.740365+0000","last_clean":"2024-09-14T07:13:34.740365+0000","last_became_active":"2024-09-14T07:13:19.655293+0000","last_became_peered":"2024-09-14T07:13:19.655293+0000","last_unstale":"2024-09-14T07:13:34.740365+0000","last_undegraded":"2024-09-14T07:13:34.740365+0000","last_fullsized":"2024-09-14T07:13:34.740365+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:04.465545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021501900000000002,"stat_sum":{"num_bytes":12308689,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":185,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.f","version":"114'541","reported_seq":4941,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.848182+0000","last_change":"2024-09-14T07:13:34.741098+0000","last_active":"2024-09-14T07:13:34.848182+0000","last_peered":"2024-09-14T07:13:34.848182+0000","last_clean":"2024-09-14T07:13:34.848182+0000","last_became_active":"2024-09-14T07:13:19.656509+0000","last_became_peered":"2024-09-14T07:13:19.656509+0000","last_unstale":"2024-09-14T07:13:34.848182+0000","last_undegraded":"2024-09-14T07:13:34.848182+0000","last_fullsized":"2024-09-14T07:13:34.848182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:59.879699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024517089999999998,"stat_sum":{"num_bytes":17088236,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":5697,"num_read_kb":18985,"num_write":576,"num_write_kb":9802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.10","version":"113'628","reported_seq":3069,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.741192+0000","last_change":"2024-09-14T07:13:34.741399+0000","last_active":"2024-09-14T07:13:34.741192+0000","last_peered":"2024-09-14T07:13:34.741192+0000","last_clean":"2024-09-14T07:13:34.741192+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:13:34.741192+0000","last_undegraded":"2024-09-14T07:13:34.741192+0000","last_fullsized":"2024-09-14T07:13:34.741192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:45.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071807900000000005,"stat_sum":{"num_bytes":11501630,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":4429,"num_read_kb":14926,"num_write":819,"num_write_kb":8563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.11","version":"114'272","reported_seq":3113,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740306+0000","last_change":"2024-09-14T07:13:34.740615+0000","last_active":"2024-09-14T07:13:34.740306+0000","last_peered":"2024-09-14T07:13:34.740306+0000","last_clean":"2024-09-14T07:13:34.740306+0000","last_became_active":"2024-09-14T07:13:19.654487+0000","last_became_peered":"2024-09-14T07:13:19.654487+0000","last_unstale":"2024-09-14T07:13:34.740306+0000","last_undegraded":"2024-09-14T07:13:34.740306+0000","last_fullsized":"2024-09-14T07:13:34.740306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:57.198552+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0024040200000000002,"stat_sum":{"num_bytes":10968522,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":2707,"num_read_kb":42530,"num_write":270,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.12","version":"114'433","reported_seq":5050,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.770906+0000","last_change":"2024-09-14T07:13:34.771167+0000","last_active":"2024-09-14T07:13:34.770906+0000","last_peered":"2024-09-14T07:13:34.770906+0000","last_clean":"2024-09-14T07:13:34.770906+0000","last_became_active":"2024-09-14T07:13:19.654705+0000","last_became_peered":"2024-09-14T07:13:19.654705+0000","last_unstale":"2024-09-14T07:13:34.770906+0000","last_undegraded":"2024-09-14T07:13:34.770906+0000","last_fullsized":"2024-09-14T07:13:34.770906+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:32.567284+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0033515580000000001,"stat_sum":{"num_bytes":1666356,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":5,"num_read":6776,"num_read_kb":9486,"num_write":385,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.13","version":"112'397","reported_seq":3544,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.739798+0000","last_change":"2024-09-14T07:13:34.740303+0000","last_active":"2024-09-14T07:13:34.739798+0000","last_peered":"2024-09-14T07:13:34.739798+0000","last_clean":"2024-09-14T07:13:34.739798+0000","last_became_active":"2024-09-14T07:13:19.656145+0000","last_became_peered":"2024-09-14T07:13:19.656145+0000","last_unstale":"2024-09-14T07:13:34.739798+0000","last_undegraded":"2024-09-14T07:13:34.739798+0000","last_fullsized":"2024-09-14T07:13:34.739798+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:35:39.251685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001805229,"stat_sum":{"num_bytes":10604286,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":3395,"num_read_kb":18676,"num_write":398,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":296573918,"num_objects":342,"num_object_clones":96,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":147,"num_read":144894,"num_read_kb":755561,"num_write":17763,"num_write_kb":401133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1465,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":75472896,"data_stored":114163541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15320,"ondisk_log_size":15320,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":60129542171,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46572,"kb_used_data":10896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325268,"statfs":{"total":96636764160,"available":96589074432,"internally_reserved":0,"allocated":11157504,"data_stored":16986534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318280,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48040,"kb_used_data":15444,"kb_used_omap":9,"kb_used_meta":32566,"kb_avail":94323800,"statfs":{"total":96636764160,"available":96587571200,"internally_reserved":0,"allocated":15814656,"data_stored":17856072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":33348232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69500,"kb_used_data":15552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94302340,"statfs":{"total":96636764160,"available":96565596160,"internally_reserved":0,"allocated":15925248,"data_stored":25673439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6856704,"data_stored":9376761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37948,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333892,"statfs":{"total":96636764160,"available":96597905408,"internally_reserved":0,"allocated":2658304,"data_stored":2254843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52328,"kb_used_data":6996,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319512,"statfs":{"total":96636764160,"available":96583180288,"internally_reserved":0,"allocated":7163904,"data_stored":10497303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58404,"kb_used_data":9164,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313436,"statfs":{"total":96636764160,"available":96576958464,"internally_reserved":0,"allocated":9383936,"data_stored":13164294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7401472,"data_stored":11895988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":9858747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1310720,"data_stored":1616189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5468160,"data_stored":8698809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13889536,"data_stored":24371724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11620352,"data_stored":11779917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9138176,"data_stored":15682100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20828160,"data_stored":30260067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:13:39.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:13:39.169 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:39.169+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:39.176 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:39.177 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:39.177 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:39.177 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:39.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:39.270 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:39.270+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:39.331 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:39.331 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:39.331 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:39.331 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:39.332 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:39.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:39.381 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:39.380+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:13:39.429 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:13:39.441 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-14T07:13:38.760502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":297164305,"num_objects":346,"num_object_clones":96,"num_object_copies":692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":147,"num_read":144960,"num_read_kb":755616,"num_write":17866,"num_write_kb":402763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1467,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15395,"ondisk_log_size":15395,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":346524,"kb_used_data":67344,"kb_used_omap":18,"kb_used_meta":277869,"kb_avail":660256356,"statfs":{"total":676457349120,"available":676102508544,"internally_reserved":0,"allocated":68960256,"data_stored":95809246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19159,"internal_metadata":284538153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-148119589,"num_objects":-82,"num_object_clones":-18,"num_object_copies":-164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-82,"num_whiteouts":-15,"num_read":1733,"num_read_kb":1474,"num_write":212,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.023534"},"pg_stats":[{"pgid":"3.1f","version":"112'564","reported_seq":4509,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.769695+0000","last_change":"2024-09-14T07:13:34.770278+0000","last_active":"2024-09-14T07:13:34.769695+0000","last_peered":"2024-09-14T07:13:34.769695+0000","last_clean":"2024-09-14T07:13:34.769695+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:13:34.769695+0000","last_undegraded":"2024-09-14T07:13:34.769695+0000","last_fullsized":"2024-09-14T07:13:34.769695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.516180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020014540000000002,"stat_sum":{"num_bytes":5710776,"num_objects":19,"num_object_clones":7,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":5889,"num_read_kb":30099,"num_write":687,"num_write_kb":17798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.1e","version":"112'296","reported_seq":4364,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740904+0000","last_change":"2024-09-14T07:13:34.741151+0000","last_active":"2024-09-14T07:13:34.740904+0000","last_peered":"2024-09-14T07:13:34.740904+0000","last_clean":"2024-09-14T07:13:34.740904+0000","last_became_active":"2024-09-14T07:12:21.794497+0000","last_became_peered":"2024-09-14T07:12:21.794497+0000","last_unstale":"2024-09-14T07:13:34.740904+0000","last_undegraded":"2024-09-14T07:13:34.740904+0000","last_fullsized":"2024-09-14T07:13:34.740904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:33.152085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050951999999999996,"stat_sum":{"num_bytes":2642710,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":4,"num_read":3833,"num_read_kb":18608,"num_write":285,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.1d","version":"110'235","reported_seq":2141,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.663023+0000","last_change":"2024-09-14T07:13:36.663455+0000","last_active":"2024-09-14T07:13:36.663023+0000","last_peered":"2024-09-14T07:13:36.663023+0000","last_clean":"2024-09-14T07:13:36.663023+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:13:36.663023+0000","last_undegraded":"2024-09-14T07:13:36.663023+0000","last_fullsized":"2024-09-14T07:13:36.663023+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:30.585692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040105160000000004,"stat_sum":{"num_bytes":9441332,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":6,"num_read":1436,"num_read_kb":8957,"num_write":224,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.1c","version":"116'551","reported_seq":2374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.711415+0000","last_change":"2024-09-14T07:13:36.663548+0000","last_active":"2024-09-14T07:13:36.711415+0000","last_peered":"2024-09-14T07:13:36.711415+0000","last_clean":"2024-09-14T07:13:36.711415+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:13:36.711415+0000","last_undegraded":"2024-09-14T07:13:36.711415+0000","last_fullsized":"2024-09-14T07:13:36.711415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:30:58.069381+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0047619239999999998,"stat_sum":{"num_bytes":21766144,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":2759,"num_read_kb":13621,"num_write":640,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.1b","version":"113'273","reported_seq":2856,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.769083+0000","last_change":"2024-09-14T07:13:34.769320+0000","last_active":"2024-09-14T07:13:34.769083+0000","last_peered":"2024-09-14T07:13:34.769083+0000","last_clean":"2024-09-14T07:13:34.769083+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:13:34.769083+0000","last_undegraded":"2024-09-14T07:13:34.769083+0000","last_fullsized":"2024-09-14T07:13:34.769083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:43.547275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001519545,"stat_sum":{"num_bytes":1213357,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":2546,"num_read_kb":18886,"num_write":297,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.1a","version":"113'687","reported_seq":3683,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.855046+0000","last_change":"2024-09-14T07:13:34.738857+0000","last_active":"2024-09-14T07:13:34.855046+0000","last_peered":"2024-09-14T07:13:34.855046+0000","last_clean":"2024-09-14T07:13:34.855046+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:13:34.855046+0000","last_undegraded":"2024-09-14T07:13:34.855046+0000","last_fullsized":"2024-09-14T07:13:34.855046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:19.384991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063855900000000002,"stat_sum":{"num_bytes":4943718,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":4963,"num_read_kb":28073,"num_write":1012,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.19","version":"112'367","reported_seq":5205,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738490+0000","last_change":"2024-09-14T07:13:34.738792+0000","last_active":"2024-09-14T07:13:34.738490+0000","last_peered":"2024-09-14T07:13:34.738490+0000","last_clean":"2024-09-14T07:13:34.738490+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:13:34.738490+0000","last_undegraded":"2024-09-14T07:13:34.738490+0000","last_fullsized":"2024-09-14T07:13:34.738490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:32.704493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054646700000000002,"stat_sum":{"num_bytes":6185803,"num_objects":13,"num_object_clones":1,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":9,"num_read":5049,"num_read_kb":21159,"num_write":433,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.18","version":"112'445","reported_seq":2909,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.768416+0000","last_change":"2024-09-14T07:13:34.768747+0000","last_active":"2024-09-14T07:13:34.768416+0000","last_peered":"2024-09-14T07:13:34.768416+0000","last_clean":"2024-09-14T07:13:34.768416+0000","last_became_active":"2024-09-14T07:12:21.797203+0000","last_became_peered":"2024-09-14T07:12:21.797203+0000","last_unstale":"2024-09-14T07:13:34.768416+0000","last_undegraded":"2024-09-14T07:13:34.768416+0000","last_fullsized":"2024-09-14T07:13:34.768416+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:07.449517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030605,"stat_sum":{"num_bytes":524288,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":498,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.17","version":"113'704","reported_seq":8213,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.770262+0000","last_change":"2024-09-14T07:13:34.770478+0000","last_active":"2024-09-14T07:13:34.770262+0000","last_peered":"2024-09-14T07:13:34.770262+0000","last_clean":"2024-09-14T07:13:34.770262+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:13:34.770262+0000","last_undegraded":"2024-09-14T07:13:34.770262+0000","last_fullsized":"2024-09-14T07:13:34.770262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:51.442318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021107069999999999,"stat_sum":{"num_bytes":10571519,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":4,"num_read":10069,"num_read_kb":40986,"num_write":868,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.16","version":"115'469","reported_seq":2621,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.659184+0000","last_change":"2024-09-14T07:13:36.660100+0000","last_active":"2024-09-14T07:13:36.659184+0000","last_peered":"2024-09-14T07:13:36.659184+0000","last_clean":"2024-09-14T07:13:36.659184+0000","last_became_active":"2024-09-14T07:13:19.656544+0000","last_became_peered":"2024-09-14T07:13:19.656544+0000","last_unstale":"2024-09-14T07:13:36.659184+0000","last_undegraded":"2024-09-14T07:13:36.659184+0000","last_fullsized":"2024-09-14T07:13:36.659184+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.119782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014386679999999999,"stat_sum":{"num_bytes":5071343,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":3216,"num_read_kb":8610,"num_write":599,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.15","version":"114'358","reported_seq":1548,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.868777+0000","last_change":"2024-09-14T07:13:34.745916+0000","last_active":"2024-09-14T07:13:34.868777+0000","last_peered":"2024-09-14T07:13:34.868777+0000","last_clean":"2024-09-14T07:13:34.868777+0000","last_became_active":"2024-09-14T07:13:19.654331+0000","last_became_peered":"2024-09-14T07:13:19.654331+0000","last_unstale":"2024-09-14T07:13:34.868777+0000","last_undegraded":"2024-09-14T07:13:34.868777+0000","last_fullsized":"2024-09-14T07:13:34.868777+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:28:11.443920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013458750000000001,"stat_sum":{"num_bytes":352534,"num_objects":9,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":1525,"num_read_kb":15257,"num_write":405,"num_write_kb":9295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.14","version":"107'758","reported_seq":3889,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.739732+0000","last_change":"2024-09-14T07:13:34.739732+0000","last_active":"2024-09-14T07:13:34.739732+0000","last_peered":"2024-09-14T07:13:34.739732+0000","last_clean":"2024-09-14T07:13:34.739732+0000","last_became_active":"2024-09-14T07:13:19.654127+0000","last_became_peered":"2024-09-14T07:13:19.654127+0000","last_unstale":"2024-09-14T07:13:34.739732+0000","last_undegraded":"2024-09-14T07:13:34.739732+0000","last_fullsized":"2024-09-14T07:13:34.739732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:54.150491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014224109999999999,"stat_sum":{"num_bytes":262275,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":5476,"num_read_kb":29545,"num_write":1141,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740542+0000","last_change":"2024-09-14T07:13:16.651496+0000","last_active":"2024-09-14T07:13:34.740542+0000","last_peered":"2024-09-14T07:13:34.740542+0000","last_clean":"2024-09-14T07:13:34.740542+0000","last_became_active":"2024-09-14T07:13:16.651181+0000","last_became_peered":"2024-09-14T07:13:16.651181+0000","last_unstale":"2024-09-14T07:13:34.740542+0000","last_undegraded":"2024-09-14T07:13:34.740542+0000","last_fullsized":"2024-09-14T07:13:34.740542+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:18.912983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"114'869","reported_seq":4415,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.819282+0000","last_change":"2024-09-14T07:13:34.769035+0000","last_active":"2024-09-14T07:13:34.819282+0000","last_peered":"2024-09-14T07:13:34.819282+0000","last_clean":"2024-09-14T07:13:34.819282+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:13:34.819282+0000","last_undegraded":"2024-09-14T07:13:34.819282+0000","last_fullsized":"2024-09-14T07:13:34.819282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:09.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012558070000000001,"stat_sum":{"num_bytes":4945207,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":5,"num_read":7262,"num_read_kb":29510,"num_write":989,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.6","version":"0'0","reported_seq":204,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738455+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:13:34.738455+0000","last_peered":"2024-09-14T07:13:34.738455+0000","last_clean":"2024-09-14T07:13:34.738455+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:13:34.738455+0000","last_undegraded":"2024-09-14T07:13:34.738455+0000","last_fullsized":"2024-09-14T07:13:34.738455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5036,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.769399+0000","last_change":"2024-09-14T07:13:34.769711+0000","last_active":"2024-09-14T07:13:34.769399+0000","last_peered":"2024-09-14T07:13:34.769399+0000","last_clean":"2024-09-14T07:13:34.769399+0000","last_became_active":"2024-09-14T07:13:19.656177+0000","last_became_peered":"2024-09-14T07:13:19.656177+0000","last_unstale":"2024-09-14T07:13:34.769399+0000","last_undegraded":"2024-09-14T07:13:34.769399+0000","last_fullsized":"2024-09-14T07:13:34.769399+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:19.611764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015409270000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.767574+0000","last_change":"2024-09-14T07:13:16.653004+0000","last_active":"2024-09-14T07:13:34.767574+0000","last_peered":"2024-09-14T07:13:34.767574+0000","last_clean":"2024-09-14T07:13:34.767574+0000","last_became_active":"2024-09-14T07:13:16.652678+0000","last_became_peered":"2024-09-14T07:13:16.652678+0000","last_unstale":"2024-09-14T07:13:34.767574+0000","last_undegraded":"2024-09-14T07:13:34.767574+0000","last_fullsized":"2024-09-14T07:13:34.767574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:09.278008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"108'947","reported_seq":5004,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.841394+0000","last_change":"2024-09-14T07:13:34.739208+0000","last_active":"2024-09-14T07:13:34.841394+0000","last_peered":"2024-09-14T07:13:34.841394+0000","last_clean":"2024-09-14T07:13:34.841394+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:13:34.841394+0000","last_undegraded":"2024-09-14T07:13:34.841394+0000","last_fullsized":"2024-09-14T07:13:34.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:47.880932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000746501,"stat_sum":{"num_bytes":7960760,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":6,"num_read":8849,"num_read_kb":23076,"num_write":1254,"num_write_kb":11182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.4","version":"0'0","reported_seq":204,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738672+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:13:34.738672+0000","last_peered":"2024-09-14T07:13:34.738672+0000","last_clean":"2024-09-14T07:13:34.738672+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:13:34.738672+0000","last_undegraded":"2024-09-14T07:13:34.738672+0000","last_fullsized":"2024-09-14T07:13:34.738672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'539","reported_seq":1374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.662983+0000","last_change":"2024-09-14T07:13:36.662983+0000","last_active":"2024-09-14T07:13:36.662983+0000","last_peered":"2024-09-14T07:13:36.662983+0000","last_clean":"2024-09-14T07:13:36.662983+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:13:36.662983+0000","last_undegraded":"2024-09-14T07:13:36.662983+0000","last_fullsized":"2024-09-14T07:13:36.662983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:43.979916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036732679999999999,"stat_sum":{"num_bytes":13883038,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":10,"num_read":2000,"num_read_kb":11530,"num_write":723,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.3","version":"114'447","reported_seq":2806,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.820760+0000","last_change":"2024-09-14T07:13:34.741323+0000","last_active":"2024-09-14T07:13:34.820760+0000","last_peered":"2024-09-14T07:13:34.820760+0000","last_clean":"2024-09-14T07:13:34.820760+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:13:34.820760+0000","last_undegraded":"2024-09-14T07:13:34.820760+0000","last_fullsized":"2024-09-14T07:13:34.820760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:21.926323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026316239999999999,"stat_sum":{"num_bytes":655445,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":2279,"num_read_kb":22380,"num_write":503,"num_write_kb":19069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.2","version":"22'2","reported_seq":106,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.658404+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:13:36.658404+0000","last_peered":"2024-09-14T07:13:36.658404+0000","last_clean":"2024-09-14T07:13:36.658404+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:13:36.658404+0000","last_undegraded":"2024-09-14T07:13:36.658404+0000","last_fullsized":"2024-09-14T07:13:36.658404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"114'288","reported_seq":4345,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.814968+0000","last_change":"2024-09-14T07:13:34.739055+0000","last_active":"2024-09-14T07:13:34.814968+0000","last_peered":"2024-09-14T07:13:34.814968+0000","last_clean":"2024-09-14T07:13:34.814968+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:13:34.814968+0000","last_undegraded":"2024-09-14T07:13:34.814968+0000","last_fullsized":"2024-09-14T07:13:34.814968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:26.037541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067425500000000001,"stat_sum":{"num_bytes":26782463,"num_objects":15,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":6,"num_read":4228,"num_read_kb":27994,"num_write":255,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738532+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:13:34.738532+0000","last_peered":"2024-09-14T07:13:34.738532+0000","last_clean":"2024-09-14T07:13:34.738532+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:13:34.738532+0000","last_undegraded":"2024-09-14T07:13:34.738532+0000","last_fullsized":"2024-09-14T07:13:34.738532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"113'277","reported_seq":3405,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.767851+0000","last_change":"2024-09-14T07:13:34.768346+0000","last_active":"2024-09-14T07:13:34.767851+0000","last_peered":"2024-09-14T07:13:34.767851+0000","last_clean":"2024-09-14T07:13:34.767851+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:13:34.767851+0000","last_undegraded":"2024-09-14T07:13:34.767851+0000","last_fullsized":"2024-09-14T07:13:34.767851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:03.976991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074572099999999997,"stat_sum":{"num_bytes":5592406,"num_objects":8,"num_object_clones":4,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":3291,"num_read_kb":29044,"num_write":290,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.738635+0000","last_change":"2024-09-14T07:13:16.651234+0000","last_active":"2024-09-14T07:13:34.738635+0000","last_peered":"2024-09-14T07:13:34.738635+0000","last_clean":"2024-09-14T07:13:34.738635+0000","last_became_active":"2024-09-14T07:13:16.650850+0000","last_became_peered":"2024-09-14T07:13:16.650850+0000","last_unstale":"2024-09-14T07:13:34.738635+0000","last_undegraded":"2024-09-14T07:13:34.738635+0000","last_fullsized":"2024-09-14T07:13:34.738635+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:14.413583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"115'327","reported_seq":1858,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.661218+0000","last_change":"2024-09-14T07:13:36.662317+0000","last_active":"2024-09-14T07:13:36.661218+0000","last_peered":"2024-09-14T07:13:36.661218+0000","last_clean":"2024-09-14T07:13:36.661218+0000","last_became_active":"2024-09-14T07:13:06.770031+0000","last_became_peered":"2024-09-14T07:13:06.770031+0000","last_unstale":"2024-09-14T07:13:36.661218+0000","last_undegraded":"2024-09-14T07:13:36.661218+0000","last_fullsized":"2024-09-14T07:13:36.661218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:46.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032200150000000001,"stat_sum":{"num_bytes":7610384,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":4,"num_read":1639,"num_read_kb":10884,"num_write":367,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"2.3","version":"20'1","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.658532+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:13:36.658532+0000","last_peered":"2024-09-14T07:13:36.658532+0000","last_clean":"2024-09-14T07:13:36.658532+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:13:36.658532+0000","last_undegraded":"2024-09-14T07:13:36.658532+0000","last_fullsized":"2024-09-14T07:13:36.658532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":257,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.767628+0000","last_change":"2024-09-14T07:13:16.660568+0000","last_active":"2024-09-14T07:13:34.767628+0000","last_peered":"2024-09-14T07:13:34.767628+0000","last_clean":"2024-09-14T07:13:34.767628+0000","last_became_active":"2024-09-14T07:13:16.654563+0000","last_became_peered":"2024-09-14T07:13:16.654563+0000","last_unstale":"2024-09-14T07:13:34.767628+0000","last_undegraded":"2024-09-14T07:13:34.767628+0000","last_fullsized":"2024-09-14T07:13:34.767628+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:51.382437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"109'422","reported_seq":3198,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.855417+0000","last_change":"2024-09-14T07:13:34.744896+0000","last_active":"2024-09-14T07:13:34.855417+0000","last_peered":"2024-09-14T07:13:34.855417+0000","last_clean":"2024-09-14T07:13:34.855417+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:13:34.855417+0000","last_undegraded":"2024-09-14T07:13:34.855417+0000","last_fullsized":"2024-09-14T07:13:34.855417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:57.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058675000000000003,"stat_sum":{"num_bytes":11873230,"num_objects":20,"num_object_clones":7,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":4584,"num_read_kb":17835,"num_write":490,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.9","version":"114'520","reported_seq":4366,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.871001+0000","last_change":"2024-09-14T07:13:34.739193+0000","last_active":"2024-09-14T07:13:34.871001+0000","last_peered":"2024-09-14T07:13:34.871001+0000","last_clean":"2024-09-14T07:13:34.871001+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:13:34.871001+0000","last_undegraded":"2024-09-14T07:13:34.871001+0000","last_fullsized":"2024-09-14T07:13:34.871001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:42.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092687800000000001,"stat_sum":{"num_bytes":4637997,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":6,"num_read":6457,"num_read_kb":37218,"num_write":486,"num_write_kb":19491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.a","version":"114'398","reported_seq":2202,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.741172+0000","last_change":"2024-09-14T07:13:34.741172+0000","last_active":"2024-09-14T07:13:34.741172+0000","last_peered":"2024-09-14T07:13:34.741172+0000","last_clean":"2024-09-14T07:13:34.741172+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:13:34.741172+0000","last_undegraded":"2024-09-14T07:13:34.741172+0000","last_fullsized":"2024-09-14T07:13:34.741172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:02.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000489767,"stat_sum":{"num_bytes":19088274,"num_objects":12,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":1966,"num_read_kb":55184,"num_write":437,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.b","version":"113'289","reported_seq":2700,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.823510+0000","last_change":"2024-09-14T07:13:34.768701+0000","last_active":"2024-09-14T07:13:34.823510+0000","last_peered":"2024-09-14T07:13:34.823510+0000","last_clean":"2024-09-14T07:13:34.823510+0000","last_became_active":"2024-09-14T07:12:21.797144+0000","last_became_peered":"2024-09-14T07:12:21.797144+0000","last_unstale":"2024-09-14T07:13:34.823510+0000","last_undegraded":"2024-09-14T07:13:34.823510+0000","last_fullsized":"2024-09-14T07:13:34.823510+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:05.591605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010133410000000001,"stat_sum":{"num_bytes":46651803,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":6,"num_read":2121,"num_read_kb":21711,"num_write":279,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.c","version":"109'740","reported_seq":6288,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.660194+0000","last_change":"2024-09-14T07:13:36.661158+0000","last_active":"2024-09-14T07:13:36.660194+0000","last_peered":"2024-09-14T07:13:36.660194+0000","last_clean":"2024-09-14T07:13:36.660194+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:13:36.660194+0000","last_undegraded":"2024-09-14T07:13:36.660194+0000","last_fullsized":"2024-09-14T07:13:36.660194+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:41.354212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020943340000000002,"stat_sum":{"num_bytes":7253527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":961,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.d","version":"116'691","reported_seq":7211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T07:13:36.665513+0000","last_change":"2024-09-14T07:13:36.665839+0000","last_active":"2024-09-14T07:13:36.665513+0000","last_peered":"2024-09-14T07:13:36.665513+0000","last_clean":"2024-09-14T07:13:36.665513+0000","last_became_active":"2024-09-14T07:13:19.658169+0000","last_became_peered":"2024-09-14T07:13:19.658169+0000","last_unstale":"2024-09-14T07:13:36.665513+0000","last_undegraded":"2024-09-14T07:13:36.665513+0000","last_fullsized":"2024-09-14T07:13:36.665513+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:43.882757+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0058405610000000002,"stat_sum":{"num_bytes":6815866,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":5,"num_read":10232,"num_read_kb":25446,"num_write":677,"num_write_kb":3827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"9","length":"6"}]},{"pgid":"3.e","version":"109'218","reported_seq":2641,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740365+0000","last_change":"2024-09-14T07:13:34.740688+0000","last_active":"2024-09-14T07:13:34.740365+0000","last_peered":"2024-09-14T07:13:34.740365+0000","last_clean":"2024-09-14T07:13:34.740365+0000","last_became_active":"2024-09-14T07:13:19.655293+0000","last_became_peered":"2024-09-14T07:13:19.655293+0000","last_unstale":"2024-09-14T07:13:34.740365+0000","last_undegraded":"2024-09-14T07:13:34.740365+0000","last_fullsized":"2024-09-14T07:13:34.740365+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:04.465545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021501900000000002,"stat_sum":{"num_bytes":12308689,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":185,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.f","version":"114'541","reported_seq":4941,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.848182+0000","last_change":"2024-09-14T07:13:34.741098+0000","last_active":"2024-09-14T07:13:34.848182+0000","last_peered":"2024-09-14T07:13:34.848182+0000","last_clean":"2024-09-14T07:13:34.848182+0000","last_became_active":"2024-09-14T07:13:19.656509+0000","last_became_peered":"2024-09-14T07:13:19.656509+0000","last_unstale":"2024-09-14T07:13:34.848182+0000","last_undegraded":"2024-09-14T07:13:34.848182+0000","last_fullsized":"2024-09-14T07:13:34.848182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:59.879699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024517089999999998,"stat_sum":{"num_bytes":17088236,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":5697,"num_read_kb":18985,"num_write":576,"num_write_kb":9802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.10","version":"113'628","reported_seq":3069,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.741192+0000","last_change":"2024-09-14T07:13:34.741399+0000","last_active":"2024-09-14T07:13:34.741192+0000","last_peered":"2024-09-14T07:13:34.741192+0000","last_clean":"2024-09-14T07:13:34.741192+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:13:34.741192+0000","last_undegraded":"2024-09-14T07:13:34.741192+0000","last_fullsized":"2024-09-14T07:13:34.741192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:45.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071807900000000005,"stat_sum":{"num_bytes":11501630,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":4429,"num_read_kb":14926,"num_write":819,"num_write_kb":8563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.11","version":"114'272","reported_seq":3113,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.740306+0000","last_change":"2024-09-14T07:13:34.740615+0000","last_active":"2024-09-14T07:13:34.740306+0000","last_peered":"2024-09-14T07:13:34.740306+0000","last_clean":"2024-09-14T07:13:34.740306+0000","last_became_active":"2024-09-14T07:13:19.654487+0000","last_became_peered":"2024-09-14T07:13:19.654487+0000","last_unstale":"2024-09-14T07:13:34.740306+0000","last_undegraded":"2024-09-14T07:13:34.740306+0000","last_fullsized":"2024-09-14T07:13:34.740306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:57.198552+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0024040200000000002,"stat_sum":{"num_bytes":10968522,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":2707,"num_read_kb":42530,"num_write":270,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.12","version":"114'433","reported_seq":5050,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.770906+0000","last_change":"2024-09-14T07:13:34.771167+0000","last_active":"2024-09-14T07:13:34.770906+0000","last_peered":"2024-09-14T07:13:34.770906+0000","last_clean":"2024-09-14T07:13:34.770906+0000","last_became_active":"2024-09-14T07:13:19.654705+0000","last_became_peered":"2024-09-14T07:13:19.654705+0000","last_unstale":"2024-09-14T07:13:34.770906+0000","last_undegraded":"2024-09-14T07:13:34.770906+0000","last_fullsized":"2024-09-14T07:13:34.770906+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:32.567284+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0033515580000000001,"stat_sum":{"num_bytes":1666356,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":5,"num_read":6776,"num_read_kb":9486,"num_write":385,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"8"}]},{"pgid":"3.13","version":"112'397","reported_seq":3544,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-14T07:13:34.739798+0000","last_change":"2024-09-14T07:13:34.740303+0000","last_active":"2024-09-14T07:13:34.739798+0000","last_peered":"2024-09-14T07:13:34.739798+0000","last_clean":"2024-09-14T07:13:34.739798+0000","last_became_active":"2024-09-14T07:13:19.656145+0000","last_became_peered":"2024-09-14T07:13:19.656145+0000","last_unstale":"2024-09-14T07:13:34.739798+0000","last_undegraded":"2024-09-14T07:13:34.739798+0000","last_fullsized":"2024-09-14T07:13:34.739798+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:35:39.251685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001805229,"stat_sum":{"num_bytes":10604286,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":3395,"num_read_kb":18676,"num_write":398,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"8"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":296573918,"num_objects":342,"num_object_clones":96,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":147,"num_read":144894,"num_read_kb":755561,"num_write":17763,"num_write_kb":401133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1465,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":75472896,"data_stored":114163541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15320,"ondisk_log_size":15320,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":60129542171,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46572,"kb_used_data":10896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325268,"statfs":{"total":96636764160,"available":96589074432,"internally_reserved":0,"allocated":11157504,"data_stored":16986534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318280,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48040,"kb_used_data":15444,"kb_used_omap":9,"kb_used_meta":32566,"kb_avail":94323800,"statfs":{"total":96636764160,"available":96587571200,"internally_reserved":0,"allocated":15814656,"data_stored":17856072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":33348232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69500,"kb_used_data":15552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94302340,"statfs":{"total":96636764160,"available":96565596160,"internally_reserved":0,"allocated":15925248,"data_stored":25673439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6856704,"data_stored":9376761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37948,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333892,"statfs":{"total":96636764160,"available":96597905408,"internally_reserved":0,"allocated":2658304,"data_stored":2254843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52328,"kb_used_data":6996,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319512,"statfs":{"total":96636764160,"available":96583180288,"internally_reserved":0,"allocated":7163904,"data_stored":10497303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58404,"kb_used_data":9164,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313436,"statfs":{"total":96636764160,"available":96576958464,"internally_reserved":0,"allocated":9383936,"data_stored":13164294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7401472,"data_stored":11895988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":9858747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1310720,"data_stored":1616189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5468160,"data_stored":8698809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13889536,"data_stored":24371724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11620352,"data_stored":11779917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9138176,"data_stored":15682100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20828160,"data_stored":30260067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:13:39.443 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T07:13:39.443 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T07:13:39.443 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-09-14T07:13:39.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:39.487 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.629093515999998, 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:39.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:13:39.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.629057904000007, 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:13:39.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:13:39.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:13:39.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.626017301999994, 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:13:39.502 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:39.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:13:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141318349999999, 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141299619000002, 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141263989999999, 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141230530000001, 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:13:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141205536000001, 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141152335999998, 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:13:39.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141131383000001, 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.536 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:13:39.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:13:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.141095321999998, 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.544 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139545001999998, 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:39.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:13:39.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139530104000002, 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:39.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:39.553 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.13951849, 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:39.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139495513, 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:13:39.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139455564000002, 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.1394339, 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139385787000002, 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.571 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:13:39.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:13:39.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139372592000001, 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:13:39.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:13:39.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.139360979999999, 2024-09-14T07:13:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:13:39.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:13:39.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:13:39.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:13:39.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.586 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:39.586 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:39.486+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:39.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:39.629 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:39.628+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:39.690 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:39.689+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:39.732 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:39.732 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:39.732 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:39.732 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:39.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:39.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-14T07:13:39.759+0000 7fe4ac304640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-09-14T07:13:39.764 INFO:teuthology.orchestra.run.smithi071.stderr:osd set-full-ratio 0.001 2024-09-14T07:13:39.791 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:39.790+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:39.861 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:39.862 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:39.862 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:39.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:39.915 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T07:13:39.914+0000 7fe7fadd3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33364) UID: 0 2024-09-14T07:13:39.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940264717999995, 2024-09-14T07:13:39.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:13:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:13:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940239246000004, 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940227573000001, 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:13:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:13:39.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940216797999994, 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:13:39.990 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:13:39.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940206257, 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:39.995 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940195789000001, 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:13:40.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940185276999998, 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:13:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940174939000002, 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:13:40.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940164596000002, 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:13:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940146007999999, 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:13:40.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940134917999998, 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:13:40.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940124216000001, 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:13:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940103467, 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:13:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940077606000003, 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940057769999996, 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:13:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.940032146999997, 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:13:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.939993337999994, 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:13:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:13:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.939972668999999, 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:13:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.934611739000005, 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:13:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.934597185000001, 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:13:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:13:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:40.067 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:40.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:40.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:40.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:40.069 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:40.067+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:40.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:40.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:40.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:40.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:40.114 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:40.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:40.131 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:40.131 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:40.148 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:40.165 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:40.294 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:40.294 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:40.295 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:40.295 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:40.295 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:40.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:40.298 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:40.298+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:40.398 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:40.398+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:40.441 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:40.441 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:40.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:40.534 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:40.533+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:40.593 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:40.593 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:40.601 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:40.600+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:40.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:40.702 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:40.702+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:40.746 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:40.746 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:40.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:40.783 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-09-14T07:13:40.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-09-14T07:13:40.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T07:13:40.842 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:40.841+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:40.875 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:40.875 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:40.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:40.927 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:40.926+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:41.005 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:41.004+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:41.031 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.031 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:41.106 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:41.105+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:41.145 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.145 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:41.207 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T07:13:41.207+0000 7f00c9460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33372) UID: 0 2024-09-14T07:13:41.297 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.297 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:41.307 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:41.306+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:41.408 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.409 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.409 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T07:13:41.408+0000 7f1860369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33342) UID: 0 2024-09-14T07:13:41.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:41.510 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:41.509+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:41.560 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.561 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:41.613 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:41.612+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:41.649 INFO:teuthology.orchestra.run.smithi071.stderr:osd set-full-ratio 0.95 2024-09-14T07:13:41.658 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-09-14T07:13:41.678 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.678 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:41.729 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:41.728+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:41.812 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:41.811+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:41.833 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.833 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:41.927 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:41.926+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:41.987 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:41.987 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:41.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:42.037 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:42.036+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:42.114 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:42.113+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:42.139 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:42.139 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:42.147 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:42.232 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:42.231+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:42.290 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:42.290 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:42.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T07:13:42.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:42.340 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T07:13:42.339+0000 7f19ad50a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33336) UID: 0 2024-09-14T07:13:42.417 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T07:13:42.416+0000 7f28c3acf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33376) UID: 0 2024-09-14T07:13:42.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-09-14T07:13:42.420 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T07:13:42.436 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-09-14T07:13:42.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T07:13:42.441 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-14T07:13:42.441 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T07:13:42.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:42.452 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-09-14T07:13:42.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T07:13:42.468 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-09-14T07:13:42.468 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T07:13:42.485 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-09-14T07:13:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T07:13:42.501 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-09-14T07:13:42.501 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T07:13:42.518 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T07:13:42.517+0000 7f539ab67640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33357) UID: 0 2024-09-14T07:13:42.518 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-09-14T07:13:42.519 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T07:13:42.536 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-09-14T07:13:42.536 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T07:13:42.558 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:42.558 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:42.558 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:42.558 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:42.558 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:42.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:42.618 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T07:13:42.618+0000 7f349bbdd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 44884) UID: 0 2024-09-14T07:13:42.676 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101015 3.5 3:a64521d3:::rbd_data.11821cead9c1.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.838014690999998, 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043484730000000003, 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.677 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101015 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836623+0000", 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-07 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836627+0000", 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836636+0000", 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9449999999999999e-06 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836642+0000", 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2449999999999998e-06 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836695+0000", 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3735e-05 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836826+0000", 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013094300000000001 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836939+0000", 2024-09-14T07:13:42.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112557 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838008+0000", 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001068989 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840911+0000", 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029033010000000001 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840943+0000", 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1738e-05 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840971+0000", 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7885000000000002e-05 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3046 3.1f e87/85 3:ffa53dc0:::rbd_data.118239a42b07.0000000000000006:22 v 87'521, mlcod=86'518)", 2024-09-14T07:13:42.683 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.873675904999999, 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045671549999999998, 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800967+0000", 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8669999999999999e-06 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800992+0000", 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4555000000000001e-05 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801048+0000", 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6093e-05 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801219+0000", 2024-09-14T07:13:42.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017133599999999999 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801245+0000", 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5439000000000002e-05 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805483+0000", 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042387969999999999 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805528+0000", 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4676999999999999e-05 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3047 3.17 e87/85 3:ea926012:::rbd_data.118239a42b07.000000000000000e:22 v 87'627, mlcod=84'624)", 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.870407524000001, 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037476889999999998, 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804230+0000", 2024-09-14T07:13:42.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804239+0000", 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9269999999999994e-06 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804252+0000", 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2679e-05 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804261+0000", 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7239999999999998e-06 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804348+0000", 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7134999999999998e-05 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804374+0000", 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6288e-05 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807887+0000", 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035127589999999998 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807977+0000", 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0101999999999999e-05 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101670 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:42.692 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.857382642000001, 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040111699999999997, 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101670 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817256+0000", 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7e-06 2024-09-14T07:13:42.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817265+0000", 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1989999999999995e-06 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817280+0000", 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4952e-05 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817288+0000", 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6879999999999999e-06 2024-09-14T07:13:42.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817356+0000", 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7979999999999996e-05 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817365+0000", 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2450000000000004e-06 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819318+0000", 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019528499999999999 2024-09-14T07:13:42.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819415+0000", 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7578999999999995e-05 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819804+0000", 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038904400000000001 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821059+0000", 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001254523 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821156+0000", 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6824999999999995e-05 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821227+0000", 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1013000000000006e-05 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821265+0000", 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8572000000000003e-05 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101676 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [watch unwatch cookie 140170150085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.846679048999999, 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041592649999999997, 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101676 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827961+0000", 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7769999999999998e-06 2024-09-14T07:13:42.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827969+0000", 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827975+0000", 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1e-06 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828225+0000", 2024-09-14T07:13:42.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024990199999999998 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828309+0000", 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3647999999999996e-05 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828455+0000", 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657200000000001 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829183+0000", 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072760100000000003 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831875+0000", 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026923089999999999 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831958+0000", 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2164999999999997e-05 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832117+0000", 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159562 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101677 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.846372135999999, 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039841629999999998, 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101677 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828266+0000", 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.001e-06 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828271+0000", 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:13:42.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828282+0000", 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0868e-05 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828302+0000", 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0245e-05 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828984+0000", 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068168600000000003 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829038+0000", 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3732e-05 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832153+0000", 2024-09-14T07:13:42.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031149929999999999 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832195+0000", 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1853000000000001e-05 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832249+0000", 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4398999999999999e-05 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101893 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 30.848577452000001, 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003596237, 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101893 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.711 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826062+0000", 2024-09-14T07:13:42.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1289999999999999e-06 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826071+0000", 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0310000000000004e-06 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826093+0000", 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2659000000000001e-05 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826104+0000", 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0379e-05 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826226+0000", 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012198500000000001 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826232+0000", 2024-09-14T07:13:42.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.533e-06 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.827997+0000", 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017645689999999999 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828088+0000", 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1317999999999995e-05 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:42.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828266+0000", 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178102 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829260+0000", 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099377699999999994 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829563+0000", 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030319599999999999 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829617+0000", 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3384000000000003e-05 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829656+0000", 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9174999999999997e-05 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101988 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 30.776478692000001, 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059469579999999996, 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101988 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898159+0000", 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1900000000000001e-07 2024-09-14T07:13:42.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898163+0000", 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.675e-06 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898170+0000", 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898174+0000", 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1409999999999998e-06 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898209+0000", 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4301000000000002e-05 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898262+0000", 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3282999999999998e-05 2024-09-14T07:13:42.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898477+0000", 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214606 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.899294+0000", 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081715499999999996 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904020+0000", 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047267430000000003 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904058+0000", 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7842000000000001e-05 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904105+0000", 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6864999999999999e-05 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102779 3.5 3:a1624695:::rbd_object_map.1182fc4f94db:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.011774263, 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041172270000000002, 2024-09-14T07:13:42.724 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102779 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662864+0000", 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.578e-06 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662871+0000", 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8210000000000004e-06 2024-09-14T07:13:42.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662884+0000", 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.324e-05 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662900+0000", 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526999999999999e-05 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662966+0000", 2024-09-14T07:13:42.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6024000000000003e-05 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663058+0000", 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1861999999999996e-05 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663178+0000", 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012068199999999999 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663663+0000", 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048430700000000001 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666909+0000", 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032459440000000002 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666944+0000", 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5748999999999999e-05 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666980+0000", 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5493000000000001e-05 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102872 3.1c 3:3cb8b5e3:::rbd_data.1182fc4f94db.0000000000000011:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 22.949698115, 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036539760000000002, 2024-09-14T07:13:42.730 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102872 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2300000000000001e-07 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724946+0000", 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1090000000000003e-06 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724954+0000", 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3920000000000003e-06 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724960+0000", 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8599999999999998e-06 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725015+0000", 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5631999999999999e-05 2024-09-14T07:13:42.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725096+0000", 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0519999999999995e-05 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725197+0000", 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101277 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726820+0000", 2024-09-14T07:13:42.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001622343 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728502+0000", 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682146 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728551+0000", 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9644000000000001e-05 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728593+0000", 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1430000000000001e-05 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103195 3.16 3:6f2974ce:::rbd_data.11823ead4c52.0000000000000005:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.949421019999999, 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036435819999999998, 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.736 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103195 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:42.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725219+0000", 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725244+0000", 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5142000000000001e-05 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725278+0000", 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4316999999999997e-05 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725306+0000", 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7392000000000001e-05 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725384+0000", 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8385000000000003e-05 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725522+0000", 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013781199999999999 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725636+0000", 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011412399999999999 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726459+0000", 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082266499999999998 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728790+0000", 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023316029999999998 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728831+0000", 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0329e-05 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728859+0000", 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8938999999999999e-05 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:103194 3.1f e101/85 3:fedd7d60:::rbd_data.11823ead4c52.0000000000000004:head v 101'539, mlcod=95'536)", 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.948407154000002, 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036764279999999998, 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.742 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.41e-07 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726234+0000", 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2189999999999998e-06 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726245+0000", 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0369e-05 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726256+0000", 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1829e-05 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726404+0000", 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014722199999999999 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726425+0000", 2024-09-14T07:13:42.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1605000000000001e-05 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729850+0000", 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003424739 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729906+0000", 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6203999999999999e-05 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103209 3.c 3:36a1ae9e:::rbd_data.11823ead4c52.0000000000000017:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.944117759000001, 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028727879999999998, 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.747 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103209 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730519+0000", 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730521+0000", 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.795e-06 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730527+0000", 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3589999999999996e-06 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730544+0000", 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6344000000000001e-05 2024-09-14T07:13:42.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730553+0000", 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5810000000000003e-06 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730631+0000", 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8174000000000001e-05 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730760+0000", 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012861599999999999 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.730877+0000", 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011691700000000001 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732342+0000", 2024-09-14T07:13:42.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014650310000000001 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733287+0000", 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00094513599999999996 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733339+0000", 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2215000000000001e-05 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.733392+0000", 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2620000000000001e-05 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103218 3.1c 3:3e959835:::rbd_data.11823ead4c52.0000000000000033:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.942264271999999, 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033495629999999998, 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.753 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103218 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732374+0000", 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1540000000000001e-06 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732378+0000", 2024-09-14T07:13:42.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3279999999999999e-06 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732390+0000", 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1717e-05 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732395+0000", 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732451+0000", 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5093999999999998e-05 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732578+0000", 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127269 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732705+0000", 2024-09-14T07:13:42.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127627 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735416+0000", 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027103299999999999 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735625+0000", 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000209101 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735680+0000", 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5634000000000003e-05 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735722+0000", 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1695e-05 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3309 3.1f e105/85 3:f9a92dd7:::rbd_data.1182f9393092.00000000000000d1:13 v 105'545, mlcod=104'542)", 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.966408628, 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052652389999999997, 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708229+0000", 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6499999999999998e-07 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708235+0000", 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-06 2024-09-14T07:13:42.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708250+0000", 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4440999999999999e-05 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708257+0000", 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7209999999999997e-06 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708328+0000", 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1724000000000006e-05 2024-09-14T07:13:42.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708349+0000", 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0424e-05 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713448+0000", 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050992950000000002 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713494+0000", 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5509000000000001e-05 2024-09-14T07:13:42.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(osd.5.0:303 3.d e105/98 ondisk, result = 0)", 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.960774712999999, 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028738940000000001, 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713862+0000", 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713863+0000", 2024-09-14T07:13:42.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9100000000000003e-07 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713867+0000", 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2490000000000003e-06 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713886+0000", 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8791e-05 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713900+0000", 2024-09-14T07:13:42.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3613e-05 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716720+0000", 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028207480000000001 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716726+0000", 2024-09-14T07:13:42.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5600000000000001e-06 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.716736+0000", 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0142e-05 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104289 3.1c 3:3852914e:::rbd_header.1182178f3240:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:42.768 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 14.022443711999999, 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039485689999999999, 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104289 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:42.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652195+0000", 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000002e-06 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652205+0000", 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7620000000000007e-06 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652295+0000", 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9728999999999994e-05 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652308+0000", 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2867999999999999e-05 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652584+0000", 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027594400000000003 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652592+0000", 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0579999999999998e-06 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653791+0000", 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001199706 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653864+0000", 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2894999999999999e-05 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.654253+0000", 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038851199999999998 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.655493+0000", 2024-09-14T07:13:42.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001239995 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656020+0000", 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000526999 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656079+0000", 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8711000000000001e-05 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656142+0000", 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3171999999999998e-05 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104384 3.2 3:41c285d9:::rbd_data.1182178f3240.0000000000000194:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.942368718000001, 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055148419999999998, 2024-09-14T07:13:42.775 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104384 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:42.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732269+0000", 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0400000000000005e-07 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732273+0000", 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0640000000000004e-06 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732285+0000", 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1419e-05 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732290+0000", 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.366e-06 2024-09-14T07:13:42.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732366+0000", 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6144999999999997e-05 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732493+0000", 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126573 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:42.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732595+0000", 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102845 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733197+0000", 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060171300000000003 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737707+0000", 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045098689999999997 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737755+0000", 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7596000000000003e-05 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737783+0000", 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8348e-05 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104385 3.16 3:6c6b45b7:::rbd_data.1182178f3240.0000000000000195:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 13.942330275, 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004426269, 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.782 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104385 2024-09-14T07:13:42.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.783 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:42.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:42.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732310+0000", 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4370000000000001e-06 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732319+0000", 2024-09-14T07:13:42.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2580000000000001e-06 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732324+0000", 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3929999999999999e-06 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732375+0000", 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0909000000000003e-05 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732449+0000", 2024-09-14T07:13:42.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4173999999999998e-05 2024-09-14T07:13:42.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:42.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732509+0000", 2024-09-14T07:13:42.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9630999999999999e-05 2024-09-14T07:13:42.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733010+0000", 2024-09-14T07:13:42.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050073999999999995 2024-09-14T07:13:42.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736671+0000", 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036615300000000001 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736703+0000", 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1287e-05 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736733+0000", 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0335e-05 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104553 3.1d 3:ba01ca6b:::rbd_data.11824d7f600c.0000000000000005:head [delete] snapc f=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 12.892211400000001, 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.947483572, 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:42.792 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104553 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:42.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782426+0000", 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2e-07 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782428+0000", 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2299999999999998e-06 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782435+0000", 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5200000000000003e-06 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782441+0000", 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.173e-06 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782489+0000", 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7692999999999999e-05 2024-09-14T07:13:42.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782497+0000", 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2309999999999996e-06 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728308+0000", 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.94581115100000002 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728457+0000", 2024-09-14T07:13:42.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014953300000000001 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 2", 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728621+0000", 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016359 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729779+0000", 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011581880000000001 2024-09-14T07:13:42.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729799+0000", 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0112999999999999e-05 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729855+0000", 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5513999999999997e-05 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:42.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729909+0000", 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4215999999999997e-05 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:42.799 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:42.801 INFO:teuthology.orchestra.run.smithi071.stdout:All operations completed A-OK! 2024-09-14T07:13:42.801 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T07:13:42.799+0000 7fcf97170640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33344) UID: 0 2024-09-14T07:13:42.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T07:13:42.802 DEBUG:teuthology.parallel:result is None 2024-09-14T07:13:42.802 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-14T07:13:42.812 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-14T07:13:42.821 INFO:tasks.thrashosds:joining thrashosds 2024-09-14T07:13:42.924 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:42.924 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:42.924 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:42.924 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:42.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T07:13:43.036 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.036 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:43.036 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:43.036 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:43.036 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T07:13:43.148 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43703 3.18 3:1a8487af:::rbd_data.1182f9393092.0000000000000020:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.289443477000006, 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.944042304, 2024-09-14T07:13:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43703 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856547+0000", 2024-09-14T07:13:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0100000000000005e-07 2024-09-14T07:13:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856551+0000", 2024-09-14T07:13:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1829999999999998e-06 2024-09-14T07:13:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856561+0000", 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856566+0000", 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.699e-06 2024-09-14T07:13:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856629+0000", 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2252e-05 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856638+0000", 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797588+0000", 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94094958299999998 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797739+0000", 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015153500000000001 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797921+0000", 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181554 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799765+0000", 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001843822 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800381+0000", 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000616633 2024-09-14T07:13:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800434+0000", 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3106000000000003e-05 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800589+0000", 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154711 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43704 3.b 3:d27a09e7:::rbd_data.1182f9393092.0000000000000021:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.289407865000001, 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94389232999999995, 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43704 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856582+0000", 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856583+0000", 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9299999999999998e-07 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856585+0000", 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.548e-06 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856592+0000", 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7660000000000001e-06 2024-09-14T07:13:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856597+0000", 2024-09-14T07:13:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.746e-06 2024-09-14T07:13:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856651+0000", 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4425999999999997e-05 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.856659+0000", 2024-09-14T07:13:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6590000000000007e-06 2024-09-14T07:13:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797631+0000", 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94097236799999995 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797734+0000", 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010265899999999999 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.797841+0000", 2024-09-14T07:13:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107025 2024-09-14T07:13:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799869+0000", 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020276439999999999 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800398+0000", 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052902899999999998 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800438+0000", 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0555e-05 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800475+0000", 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6412000000000003e-05 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:43863 3.b 3:d03db965:::rbd_data.1182f9393092.0000000000000026:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.286367263000002, 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.94105812899999997, 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 43863 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859623+0000", 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859624+0000", 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859629+0000", 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859643+0000", 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4307999999999999e-05 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859651+0000", 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2490000000000001e-06 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859714+0000", 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3020000000000003e-05 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:20.859720+0000", 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799014+0000", 2024-09-14T07:13:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.93929329500000003 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799127+0000", 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011315900000000001 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.799286+0000", 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158887 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-14T07:13:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800332+0000", 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010459600000000001 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800628+0000", 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029634600000000001 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800657+0000", 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8422999999999999e-05 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:21.800681+0000", 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4579999999999998e-05 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88170 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2293760~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801668311, 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083523651000000004, 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88170 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344322+0000", 2024-09-14T07:13:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3500000000000002e-07 2024-09-14T07:13:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344325+0000", 2024-09-14T07:13:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1780000000000002e-06 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344330+0000", 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.609e-06 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344335+0000", 2024-09-14T07:13:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4580000000000003e-06 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427499+0000", 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083163965000000006 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427548+0000", 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9033999999999998e-05 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427846+0000", 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029797200000000003 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88171 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2621440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801649580000003, 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083896016000000004, 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88171 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344341+0000", 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7899999999999999e-07 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344343+0000", 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9350000000000001e-06 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344349+0000", 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7710000000000003e-06 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344368+0000", 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9378999999999999e-05 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427880+0000", 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083512111999999999 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.427929+0000", 2024-09-14T07:13:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8380000000000001e-05 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428237+0000", 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030805999999999997 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88172 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 2949120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801613951, 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084244834000000005, 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88172 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344376+0000", 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344377+0000", 2024-09-14T07:13:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0900000000000002e-07 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344379+0000", 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1940000000000001e-06 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344396+0000", 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7575e-05 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344402+0000", 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.631e-06 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428270+0000", 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.083868266999999996 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428316+0000", 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428621+0000", 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030511900000000002 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88173 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3276800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801580491000003, 2024-09-14T07:13:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084580010999999997, 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88173 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344410+0000", 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4900000000000001e-07 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344412+0000", 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1849999999999998e-06 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344423+0000", 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0336999999999999e-05 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344428+0000", 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4519999999999996e-06 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428653+0000", 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084225217000000005 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428700+0000", 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6143999999999997e-05 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.428990+0000", 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000290227 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88174 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3604480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801555497000003, 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084949347999999994, 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88174 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344435+0000", 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2e-07 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344437+0000", 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1179999999999999e-06 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344443+0000", 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344464+0000", 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0766000000000001e-05 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429020+0000", 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084556400000000004 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429068+0000", 2024-09-14T07:13:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8102999999999997e-05 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429384+0000", 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031563099999999997 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88175 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 3932160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801502296999999, 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085304563999999999, 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88175 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344488+0000", 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344489+0000", 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8700000000000005e-07 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344492+0000", 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9510000000000002e-06 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344498+0000", 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4110000000000001e-06 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344502+0000", 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429401+0000", 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084898378999999996 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429447+0000", 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429793+0000", 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034521399999999999 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88176 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4259840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801481344000003, 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085643206999999999, 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88176 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344509+0000", 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344522+0000", 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2824e-05 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344525+0000", 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.298e-06 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344533+0000", 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7970000000000001e-06 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344538+0000", 2024-09-14T07:13:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7770000000000002e-06 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429822+0000", 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085284147000000005 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.429870+0000", 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7808e-05 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430152+0000", 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000282556 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88177 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.801445283, 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085729394, 2024-09-14T07:13:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88177 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.344545+0000", 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346064+0000", 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015190100000000001 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346068+0000", 2024-09-14T07:13:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5240000000000002e-06 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346077+0000", 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5909999999999996e-06 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346084+0000", 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430181+0000", 2024-09-14T07:13:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084097432999999999 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430232+0000", 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0540000000000001e-05 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430274+0000", 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2611999999999998e-05 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88178 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799894963, 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084292631000000007, 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88178 2024-09-14T07:13:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346095+0000", 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346096+0000", 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346097+0000", 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5230000000000001e-06 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346102+0000", 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2209999999999996e-06 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346106+0000", 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430300+0000", 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084194019999999994 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430345+0000", 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5816999999999999e-05 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430388+0000", 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88179 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5242880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799880064999996, 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084424117000000007, 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88179 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346110+0000", 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.29e-07 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346112+0000", 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346116+0000", 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1099999999999996e-06 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346118+0000", 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5339999999999998e-06 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430429+0000", 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.08431073 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430491+0000", 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2002999999999996e-05 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430534+0000", 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3299e-05 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88180 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799868451000002, 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084534616000000007, 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88180 2024-09-14T07:13:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346122+0000", 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1e-07 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346128+0000", 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6509999999999998e-06 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346133+0000", 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6239999999999999e-06 2024-09-14T07:13:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346138+0000", 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8180000000000003e-06 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430572+0000", 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084433929000000005 2024-09-14T07:13:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430615+0000", 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3271e-05 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430656+0000", 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1013000000000002e-05 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88181 3.1 3:850c4bc0:::rbd_data.1182af6f1d9e.0000000000000005:1f [read 5898240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799845474000001, 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084631627000000001, 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88181 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346145+0000", 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.89e-07 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346147+0000", 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8759999999999999e-06 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346155+0000", 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.379e-06 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346159+0000", 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6450000000000004e-06 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430693+0000", 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084533443999999999 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430736+0000", 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3480999999999999e-05 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430776+0000", 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0312999999999998e-05 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88202 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799805524999996, 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085008170999999993, 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88202 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346185+0000", 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.58e-07 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346187+0000", 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0700000000000001e-06 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346195+0000", 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9060000000000002e-06 2024-09-14T07:13:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346200+0000", 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8289999999999998e-06 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430801+0000", 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.084601265999999994 2024-09-14T07:13:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.430844+0000", 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2426999999999999e-05 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431193+0000", 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000349315 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88203 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799783861000002, 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085417398000000005, 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88203 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346206+0000", 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346207+0000", 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.34e-07 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346209+0000", 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.917e-06 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346220+0000", 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1328000000000001e-05 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346225+0000", 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-09-14T07:13:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431235+0000", 2024-09-14T07:13:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085009418000000003 2024-09-14T07:13:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431296+0000", 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1216000000000005e-05 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431624+0000", 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032787499999999999 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88204 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 786432~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799735748000003, 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085779599999999998, 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88204 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346254+0000", 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346255+0000", 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346256+0000", 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.48e-06 2024-09-14T07:13:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346260+0000", 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9729999999999999e-06 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346263+0000", 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431661+0000", 2024-09-14T07:13:43.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085397379999999995 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.431708+0000", 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6896e-05 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432034+0000", 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032642499999999998 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88205 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1114112~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799722553000002, 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086386911999999996, 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88205 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346268+0000", 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.27e-07 2024-09-14T07:13:43.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346269+0000", 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200000000000001e-06 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346272+0000", 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0280000000000001e-06 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346275+0000", 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7389999999999999e-06 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432073+0000", 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.085797618000000006 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432151+0000", 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7879000000000004e-05 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432655+0000", 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050400100000000001 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:88206 3.1 3:82ca846a:::rbd_data.1182af6f1d9e.0000000000000000:1f [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.799710941000001, 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.086842845000000002, 2024-09-14T07:13:43.255 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 88206 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.346279+0000", 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352017+0000", 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057373670000000002 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352025+0000", 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7299999999999994e-06 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352036+0000", 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0308e-05 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.352044+0000", 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2989999999999997e-06 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432692+0000", 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.080648005999999994 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.432780+0000", 2024-09-14T07:13:43.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8242e-05 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.433122+0000", 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034189300000000001 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.260 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T07:13:43.364 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:43.365 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T07:13:43.475 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:43.475 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T07:13:43.587 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.587 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44682 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3948544~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550635880000002, 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060580071999999999, 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.588 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44682 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035510+0000", 2024-09-14T07:13:43.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035511+0000", 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.72e-07 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035513+0000", 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0219999999999999e-06 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035520+0000", 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9600000000000003e-06 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035525+0000", 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1449999999999999e-06 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095859+0000", 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060334549000000001 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.095901+0000", 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1887000000000001e-05 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096090+0000", 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000189137 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.592 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44683 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2908160~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550610407999997, 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060841536000000002, 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44683 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035536+0000", 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4999999999999999e-07 2024-09-14T07:13:43.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035537+0000", 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.393e-06 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035542+0000", 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1749999999999998e-06 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035544+0000", 2024-09-14T07:13:43.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7190000000000001e-06 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096123+0000", 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060578765999999999 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096170+0000", 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7005999999999997e-05 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096377+0000", 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020722700000000001 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44684 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4005888~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550598734999994, 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061065854000000003, 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.597 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44684 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035547+0000", 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035548+0000", 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035549+0000", 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1000000000000001e-06 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035553+0000", 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035555+0000", 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.695e-06 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096393+0000", 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060837732999999998 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096436+0000", 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3374999999999997e-05 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096613+0000", 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017690300000000001 2024-09-14T07:13:43.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44685 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 2965504~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550587960000001, 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061325098000000001, 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.602 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44685 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035558+0000", 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1899999999999999e-07 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035559+0000", 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5099999999999998e-07 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035563+0000", 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9310000000000001e-06 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035566+0000", 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.593e-06 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096647+0000", 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061081457999999998 2024-09-14T07:13:43.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096692+0000", 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4960999999999999e-05 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096883+0000", 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019098499999999999 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44686 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4063232~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550577419000007, 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061552633000000002, 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.607 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44686 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035569+0000", 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035570+0000", 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.006e-06 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035574+0000", 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8380000000000004e-06 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035576+0000", 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096908+0000", 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061331745 2024-09-14T07:13:43.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.096961+0000", 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2908000000000002e-05 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097121+0000", 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016034299999999999 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44687 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3022848~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550566950999993, 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061810125, 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44687 2024-09-14T07:13:43.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035579+0000", 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035580+0000", 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035584+0000", 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.799e-06 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035587+0000", 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6529999999999998e-06 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097155+0000", 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061568075 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097202+0000", 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6859e-05 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097389+0000", 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187527 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44688 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4120576~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550556439000005, 2024-09-14T07:13:43.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062053639000000001, 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44688 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035590+0000", 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.11e-07 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035591+0000", 2024-09-14T07:13:43.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1510000000000001e-06 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035595+0000", 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035597+0000", 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.615e-06 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097413+0000", 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.061815446000000003 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097459+0000", 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884000000000003e-05 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097643+0000", 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018463600000000001 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.623 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44689 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3080192~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550546100999995, 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062313194000000002, 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44689 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035600+0000", 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035601+0000", 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035605+0000", 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.766e-06 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035608+0000", 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.52e-06 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097677+0000", 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062069645999999999 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097724+0000", 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6665000000000001e-05 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097913+0000", 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018936300000000001 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44690 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 4177920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550535757999995, 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062563556000000006, 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44690 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.629 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035610+0000", 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035611+0000", 2024-09-14T07:13:43.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035614+0000", 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.675e-06 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035619+0000", 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2520000000000001e-06 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035624+0000", 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1510000000000003e-06 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097944+0000", 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062319939999999997 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.097987+0000", 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3643999999999998e-05 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098174+0000", 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018666200000000001 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44691 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3137536~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550517170000006, 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062802233999999998, 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.633 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44691 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035629+0000", 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100000000000001e-07 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035630+0000", 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035634+0000", 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0369999999999996e-06 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035637+0000", 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098209+0000", 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062572265000000002 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098257+0000", 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7382999999999997e-05 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098431+0000", 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017445399999999999 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44692 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3153920~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550506080000005, 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062913500999999997, 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44692 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035640+0000", 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.04e-07 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035641+0000", 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5900000000000005e-07 2024-09-14T07:13:43.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035645+0000", 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.861e-06 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035648+0000", 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.633e-06 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098459+0000", 2024-09-14T07:13:43.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062811045999999995 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098504+0000", 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.507e-05 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098554+0000", 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9728000000000002e-05 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.641 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44693 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3162112~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550495377999994, 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063035268000000005, 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.642 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44693 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035651+0000", 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-07 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035653+0000", 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5430000000000001e-06 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035659+0000", 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035666+0000", 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098586+0000", 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.062920658000000004 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098632+0000", 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5432999999999997e-05 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098686+0000", 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4366000000000001e-05 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44694 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3211264~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550474629000007, 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063129721, 2024-09-14T07:13:43.646 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44694 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035672+0000", 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035674+0000", 2024-09-14T07:13:43.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7710000000000001e-06 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035681+0000", 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3549999999999999e-06 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035691+0000", 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0005e-05 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098709+0000", 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063018480000000002 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098752+0000", 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2886999999999998e-05 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098801+0000", 2024-09-14T07:13:43.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8851999999999999e-05 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44695 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3219456~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550448767999995, 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063230596, 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.651 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44695 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035697+0000", 2024-09-14T07:13:43.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035698+0000", 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035700+0000", 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0420000000000001e-06 2024-09-14T07:13:43.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035706+0000", 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.84e-06 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035712+0000", 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098833+0000", 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063121408000000004 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098876+0000", 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3241000000000002e-05 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098928+0000", 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1731000000000003e-05 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44696 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3268608~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550428932000003, 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063330998999999999, 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.656 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44696 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035717+0000", 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035718+0000", 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5199999999999998e-07 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035719+0000", 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8220000000000001e-06 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035730+0000", 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0587999999999999e-05 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035735+0000", 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6800000000000001e-06 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098957+0000", 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063222046000000004 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.098999+0000", 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2531999999999999e-05 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099048+0000", 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8979e-05 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44697 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3276800~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550403309000004, 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063432949000000002, 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44697 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035743+0000", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1800000000000001e-07 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035745+0000", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.029e-06 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035754+0000", 2024-09-14T07:13:43.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2539999999999992e-06 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035759+0000", 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2000000000000002e-06 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099080+0000", 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063321266000000001 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099123+0000", 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3157e-05 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099176+0000", 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2624999999999998e-05 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44698 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3325952~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550364500000001, 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063508462000000002, 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44698 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:43.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035782+0000", 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1699999999999999e-07 2024-09-14T07:13:43.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035784+0000", 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035790+0000", 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.939e-06 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035797+0000", 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7399999999999998e-06 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099199+0000", 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063401590999999993 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099241+0000", 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2378e-05 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099290+0000", 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8918999999999997e-05 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44699 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3334144~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.550343831000006, 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.063612923000000002, 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44699 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.035802+0000", 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040958+0000", 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051556639999999999 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040962+0000", 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8279999999999996e-06 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040970+0000", 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9810000000000003e-06 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.040976+0000", 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8989999999999998e-06 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099321+0000", 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.058345419000000003 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099364+0000", 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3081000000000003e-05 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.099415+0000", 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1051000000000003e-05 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44714 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3842048~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.674 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.544982900999997, 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060668674999999998, 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44714 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041163+0000", 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041167+0000", 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7510000000000002e-06 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041172+0000", 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4800000000000003e-06 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041175+0000", 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:43.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101615+0000", 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060440767999999999 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101657+0000", 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2051000000000001e-05 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101832+0000", 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017450199999999999 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:44715 3.0 3:06bb077a:::rbd_data.118272ecf6fb.0000000000000001:12 [read 3735552~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.544968346999994, 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.060893586, 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44715 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.041178+0000", 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047077+0000", 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058990919999999999 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047082+0000", 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0679999999999996e-06 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047091+0000", 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5900000000000008e-06 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.047097+0000", 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0920000000000003e-06 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101864+0000", 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.054767165999999999 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.101909+0000", 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4937e-05 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:22.102071+0000", 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016264099999999999 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:43.683 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T07:13:43.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T07:13:43.832 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.832 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:43.832 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:43.832 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T07:13:43.945 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:43.946 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:43.946 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:43.946 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:43.954 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T07:13:44.058 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:7879 3.0 e34/23 3:0734cff8:::rbd_data.1182a7d91484.0000000000000046:head v 34'28, mlcod=32'25)", 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.28930676900001, 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048377719999999997, 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767962+0000", 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767963+0000", 2024-09-14T07:13:44.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767970+0000", 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9190000000000002e-06 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767983+0000", 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2781e-05 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.767990+0000", 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768079+0000", 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8659000000000006e-05 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.768099+0000", 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0424e-05 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772757+0000", 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004657815 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:03.772800+0000", 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2846999999999998e-05 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.063 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12730 3.0 e38/23 3:02e1a3ea:::rbd_data.1182a59bd9ad.0000000000000010:head v 38'50, mlcod=38'47)", 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.249169605000006, 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035880339999999999, 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808099+0000", 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808101+0000", 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.64e-06 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808110+0000", 2024-09-14T07:13:44.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3130000000000004e-06 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808130+0000", 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9422000000000001e-05 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808138+0000", 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7469999999999994e-06 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808205+0000", 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6668000000000006e-05 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808228+0000", 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2736999999999999e-05 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811637+0000", 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034097509999999999 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811687+0000", 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9756000000000003e-05 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:12734 3.4 e38/23 3:233fa140:::rbd_data.1182a59bd9ad.000000000000013f:head v 38'72, mlcod=37'69)", 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.249100190999997, 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038572929999999999, 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808169+0000", 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5900000000000003e-07 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808184+0000", 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5429000000000001e-05 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808191+0000", 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7390000000000002e-06 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808196+0000", 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6290000000000001e-06 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808408+0000", 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000211824 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.808427+0000", 2024-09-14T07:13:44.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9573999999999999e-05 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.811983+0000", 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003555519 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:07.812026+0000", 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3220000000000003e-05 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:17080 3.9 e41/23 3:92874496:::rbd_data.11826f680556.0000000000000002:head v 41'112, mlcod=41'109)", 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.408722166000004, 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068314430000000004, 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648547+0000", 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.648548+0000", 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.714e-06 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650735+0000", 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021865090000000001 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650750+0000", 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5062000000000001e-05 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650756+0000", 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4239999999999998e-06 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650810+0000", 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3304999999999999e-05 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.650827+0000", 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7048e-05 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655331+0000", 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045040119999999999 2024-09-14T07:13:44.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:11.655378+0000", 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7369e-05 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25123 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'89, mlcod=47'87)", 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.943066032000004, 2024-09-14T07:13:44.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186049999999997, 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114203+0000", 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.114204+0000", 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7e-06 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115477+0000", 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012725499999999999 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115498+0000", 2024-09-14T07:13:44.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1203999999999999e-05 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115508+0000", 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9709999999999999e-06 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115620+0000", 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111316 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.115645+0000", 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5561000000000001e-05 2024-09-14T07:13:44.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122473+0000", 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068281749999999997 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.122521+0000", 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8127999999999997e-05 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:25124 3.4 e47/23 3:23614a13:::rbd_data.1182aef26e7e.0000000000000003:head v 47'91, mlcod=47'87)", 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.939037733999996, 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060764809999999999, 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118231+0000", 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118232+0000", 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.096e-06 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118242+0000", 2024-09-14T07:13:44.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6160000000000008e-06 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118261+0000", 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225e-05 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118271+0000", 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4879999999999996e-06 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118331+0000", 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0850999999999997e-05 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.118355+0000", 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3142999999999998e-05 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124259+0000", 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059043180000000004 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.124308+0000", 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28367 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'84, mlcod=41'82)", 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.718038610999997, 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067547429999999997, 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339230+0000", 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339232+0000", 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3999999999999999e-06 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339686+0000", 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045457499999999998 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339701+0000", 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4977000000000001e-05 2024-09-14T07:13:44.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339709+0000", 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.593e-06 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339769+0000", 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0655000000000001e-05 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.339799+0000", 2024-09-14T07:13:44.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9578999999999999e-05 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345943+0000", 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061444300000000002 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.345985+0000", 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1533999999999999e-05 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:28368 3.0 e47/23 3:079aa2c5:::rbd_data.1182aef26e7e.000000000000001c:head v 47'86, mlcod=41'82)", 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.714520800000003, 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036513359999999998, 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342748+0000", 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342749+0000", 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.159e-06 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342759+0000", 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342774+0000", 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5506999999999999e-05 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342784+0000", 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4730000000000006e-06 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342835+0000", 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1304999999999998e-05 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.342856+0000", 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1299999999999999e-05 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346367+0000", 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035108779999999998 2024-09-14T07:13:44.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.346399+0000", 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1999999999999999e-05 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:83495 3.9 e65/23 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:head v 65'227, mlcod=65'224)", 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.244381820000001, 2024-09-14T07:13:44.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011884904, 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812887+0000", 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.812889+0000", 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.573e-06 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816901+0000", 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040123290000000002 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816922+0000", 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1327000000000001e-05 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.816932+0000", 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2769999999999994e-06 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817024+0000", 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2985999999999994e-05 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.817048+0000", 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3048999999999999e-05 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824615+0000", 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075671849999999997 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:40.824772+0000", 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015717800000000001 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:88473 3.4 e68/23 3:252e0f68:::rbd_data.11821ba4736d.0000000000000009:head v 68'451, mlcod=65'448)", 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.59201848, 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084034639999999994, 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465250+0000", 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.465252+0000", 2024-09-14T07:13:44.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8160000000000001e-06 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466598+0000", 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013462089999999999 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466620+0000", 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466631+0000", 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.094e-05 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466705+0000", 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4190000000000006e-05 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.466731+0000", 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6375000000000001e-05 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473614+0000", 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068826310000000002 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:43.473654+0000", 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0021000000000002e-05 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.104 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91257 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'241, mlcod=70'239)", 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.253520039000001, 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012763226000000001, 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.803749+0000", 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.67e-07 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808282+0000", 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004533217 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808305+0000", 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3309999999999999e-05 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808316+0000", 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0366e-05 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808378+0000", 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1974e-05 2024-09-14T07:13:44.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.808402+0000", 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3986999999999999e-05 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816472+0000", 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080701709999999992 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816512+0000", 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0034000000000003e-05 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:91258 3.9 e73/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:head v 73'243, mlcod=70'239)", 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.247872135999998, 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074511259999999998, 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.109 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809397+0000", 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809398+0000", 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2750000000000001e-06 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809404+0000", 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1750000000000002e-06 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809412+0000", 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8229999999999995e-06 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.809416+0000", 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.907e-06 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812206+0000", 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027904449999999999 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.812238+0000", 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1482000000000001e-05 2024-09-14T07:13:44.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816812+0000", 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045746959999999996 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:48.816848+0000", 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5323e-05 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95641 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'750, mlcod=74'747)", 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.510385452999998, 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051093290000000001, 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546883+0000", 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546884+0000", 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546888+0000", 2024-09-14T07:13:44.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.98e-06 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546897+0000", 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0569999999999999e-06 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.546902+0000", 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2580000000000003e-06 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547654+0000", 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075227200000000001 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.547675+0000", 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1134000000000001e-05 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551955+0000", 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042797929999999996 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.551993+0000", 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7450000000000002e-05 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:95847 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'786, mlcod=74'783)", 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.282499551999997, 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045921950000000003, 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774769+0000", 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774770+0000", 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774782+0000", 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2037e-05 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774795+0000", 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2833999999999999e-05 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774802+0000", 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2339999999999997e-06 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774849+0000", 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7082000000000001e-05 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.774867+0000", 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7493999999999999e-05 2024-09-14T07:13:44.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779310+0000", 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044429810000000004 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:52.779361+0000", 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1734000000000003e-05 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96051 3.4 e74/23 3:24c0c5f7:::rbd_data.1182b30ae915.000000000000000c:head v 74'823, mlcod=74'820)", 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.029802777999997, 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046975669999999997, 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027466+0000", 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027467+0000", 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6400000000000002e-07 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027479+0000", 2024-09-14T07:13:44.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2109e-05 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027491+0000", 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1984000000000001e-05 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027497+0000", 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3010000000000003e-06 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027542+0000", 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5167999999999999e-05 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.027561+0000", 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8828999999999999e-05 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032121+0000", 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045600079999999999 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.032164+0000", 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2503999999999998e-05 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:96076 3.4 e74/23 3:2187247a:::rbd_data.1182b30ae915.0000000000000002:head v 74'831, mlcod=74'828)", 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.987855168000003, 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036248119999999998, 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069414+0000", 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6400000000000001e-07 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069420+0000", 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9179999999999999e-06 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069432+0000", 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1216000000000001e-05 2024-09-14T07:13:44.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069439+0000", 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8909999999999995e-06 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069494+0000", 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4171e-05 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.069511+0000", 2024-09-14T07:13:44.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7697999999999999e-05 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.072996+0000", 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034849149999999999 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:53.073038+0000", 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2239e-05 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(osd.4.0:3560 3.9 e87/23 3:9720df75:::rbd_data.118239a42b07.0000000000000001:22 v 87'485, mlcod=86'482)", 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.258732545000001, 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038721369999999999, 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798536+0000", 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798537+0000", 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7700000000000005e-07 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798543+0000", 2024-09-14T07:13:44.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798553+0000", 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.611e-06 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798562+0000", 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4210000000000001e-06 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798621+0000", 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9264e-05 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.798642+0000", 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0996e-05 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802363+0000", 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037204899999999999 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:07.802408+0000", 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5435999999999997e-05 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4482.0:105805 3.4 e117/23 3:235cf235:::rbd_header.1182b13d849f:head v 117'955, mlcod=116'953)", 2024-09-14T07:13:44.136 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:37.754353+0000", 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.3029158120000002, 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087489879999999992, 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754353+0000", 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754353+0000", 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754354+0000", 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.51e-07 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754359+0000", 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8599999999999998e-06 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754370+0000", 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0239e-05 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754379+0000", 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.884e-06 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754428+0000", 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162999999999997e-05 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.754447+0000", 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9661e-05 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.763057+0000", 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086099200000000001 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:37.763102+0000", 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4709999999999997e-05 2024-09-14T07:13:44.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(osd.1.0:1572 3.4 e118/23 3:20b4893f:::rbd_data.1182a7d91484.0000000000000013:7 v 118'973, mlcod=117'970)", 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:38.764758+0000", 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.292511148, 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004675523, 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764758+0000", 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764758+0000", 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764759+0000", 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4300000000000002e-07 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764765+0000", 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3640000000000004e-06 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764776+0000", 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0692e-05 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764784+0000", 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3550000000000005e-06 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764944+0000", 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016022200000000001 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.764964+0000", 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9369e-05 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.769391+0000", 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044277099999999996 2024-09-14T07:13:44.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.769433+0000", 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1968000000000002e-05 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(osd.1.0:1573 3.4 e118/23 3:215dbae5:::rbd_data.1182a7d91484.0000000000000024:7 v 118'975, mlcod=117'970)", 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:13:38.765760+0000", 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.2915085819999996, 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044582670000000001, 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.145 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765760+0000", 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765760+0000", 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765761+0000", 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765767+0000", 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3319999999999997e-06 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765784+0000", 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6109000000000001e-05 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765790+0000", 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8909999999999998e-06 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765844+0000", 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3213e-05 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.765862+0000", 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8031999999999999e-05 2024-09-14T07:13:44.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.770177+0000", 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043147999999999997 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:13:38.770219+0000", 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1971000000000002e-05 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.149 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:44.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T07:13:44.254 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:44.254 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:44.254 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-14T07:13:44.254 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:44.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T07:13:44.366 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-14T07:13:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-14T07:13:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-14T07:13:44.366 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:44.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T07:13:44.479 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22051 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1921024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509306166000002, 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089693667000000005, 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22051 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969072+0000", 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969073+0000", 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8500000000000002e-07 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969075+0000", 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.984e-06 2024-09-14T07:13:44.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969081+0000", 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.596e-06 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969086+0000", 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5379999999999996e-06 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058645+0000", 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089559024000000001 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058710+0000", 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5173999999999996e-05 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058766+0000", 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22053 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1978368~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509273813999997, 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089811099000000005, 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22053 2024-09-14T07:13:44.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969104+0000", 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969105+0000", 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0999999999999999e-07 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969107+0000", 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969113+0000", 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6510000000000004e-06 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969118+0000", 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.702e-06 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058793+0000", 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089674845000000003 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058858+0000", 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4667999999999998e-05 2024-09-14T07:13:44.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058916+0000", 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7840000000000002e-05 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22055 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2035712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509189163000002, 2024-09-14T07:13:44.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089880242999999999, 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22055 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969189+0000", 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969190+0000", 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4199999999999995e-07 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969192+0000", 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.779e-06 2024-09-14T07:13:44.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969200+0000", 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5170000000000002e-06 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969206+0000", 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4970000000000001e-06 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.058945+0000", 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089739159999999998 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059012+0000", 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7002999999999995e-05 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059069+0000", 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7645000000000001e-05 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22057 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2093056~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509163803999996, 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090002862000000003, 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.494 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22057 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969214+0000", 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969215+0000", 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969217+0000", 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969223+0000", 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.19e-06 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969228+0000", 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059095+0000", 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089866506999999998 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059160+0000", 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5502999999999999e-05 2024-09-14T07:13:44.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059217+0000", 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7290000000000002e-05 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22058 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1867776~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509131096000004, 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090117803999999996, 2024-09-14T07:13:44.498 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22058 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969247+0000", 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969248+0000", 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4999999999999998e-07 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969250+0000", 2024-09-14T07:13:44.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.001e-06 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969256+0000", 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969261+0000", 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5669999999999996e-06 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059243+0000", 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.089982021999999995 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059308+0000", 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5926000000000005e-05 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059365+0000", 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6483000000000001e-05 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22060 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1925120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509098972000004, 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090231327, 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22060 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969279+0000", 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969280+0000", 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8100000000000003e-07 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969282+0000", 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8870000000000001e-06 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969288+0000", 2024-09-14T07:13:44.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3500000000000002e-06 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969293+0000", 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5519999999999998e-06 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059390+0000", 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090097761999999998 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059455+0000", 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4634000000000005e-05 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059511+0000", 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5661000000000001e-05 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22062 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1982464~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:44.507 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509067553999998, 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090345623999999999, 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22062 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969311+0000", 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:44.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969317+0000", 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4229999999999996e-06 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969323+0000", 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2450000000000003e-06 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969328+0000", 2024-09-14T07:13:44.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6820000000000002e-06 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059537+0000", 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090208968 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059602+0000", 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5691000000000005e-05 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059656+0000", 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4075e-05 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22064 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2039808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509043585000001, 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090466664000000002, 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22064 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969335+0000", 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.08e-07 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969337+0000", 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9010000000000001e-06 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969343+0000", 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969347+0000", 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3540000000000002e-06 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059681+0000", 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090333842999999997 2024-09-14T07:13:44.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059747+0000", 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5703000000000004e-05 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059801+0000", 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4355999999999999e-05 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22067 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1871872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509023886999998, 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090595428000000006, 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22067 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.517 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969354+0000", 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969355+0000", 2024-09-14T07:13:44.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.32e-07 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969357+0000", 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.891e-06 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969361+0000", 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7720000000000002e-06 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969364+0000", 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7070000000000001e-06 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059826+0000", 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090461615999999995 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059889+0000", 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3540000000000005e-05 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059950+0000", 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0470000000000002e-05 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22069 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1929216~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.509009945000003, 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090723230000000002, 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.521 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22069 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969368+0000", 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969369+0000", 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3999999999999998e-07 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969370+0000", 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-06 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969374+0000", 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969376+0000", 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6410000000000002e-06 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.059974+0000", 2024-09-14T07:13:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090597311 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060037+0000", 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2854000000000005e-05 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060092+0000", 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4985999999999998e-05 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22071 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1986560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508998715000004, 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090859740999999994, 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22071 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969380+0000", 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969381+0000", 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3969999999999999e-06 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969385+0000", 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9190000000000001e-06 2024-09-14T07:13:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969388+0000", 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060116+0000", 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090728619999999996 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060179+0000", 2024-09-14T07:13:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3113000000000004e-05 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060239+0000", 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9981000000000001e-05 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22073 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2043904~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508987587000007, 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091003586999999997, 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22073 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969391+0000", 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969392+0000", 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.052e-06 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969395+0000", 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969399+0000", 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-06 2024-09-14T07:13:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060266+0000", 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.090867139999999999 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060334+0000", 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8439e-05 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060394+0000", 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9957000000000002e-05 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22076 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1875968~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508976425, 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091143724999999995, 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22076 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969402+0000", 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3799999999999999e-07 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969403+0000", 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.001e-06 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969407+0000", 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969410+0000", 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5689999999999999e-06 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060420+0000", 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091010275000000002 2024-09-14T07:13:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060487+0000", 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6729000000000004e-05 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060546+0000", 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9023000000000001e-05 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22078 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1933312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508965713999999, 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091282920000000004, 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22078 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969413+0000", 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-07 2024-09-14T07:13:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969414+0000", 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5499999999999996e-07 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969417+0000", 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969419+0000", 2024-09-14T07:13:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4490000000000002e-06 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060571+0000", 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.09115144 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060636+0000", 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5411000000000001e-05 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060695+0000", 2024-09-14T07:13:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9419999999999997e-05 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22080 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1990656~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508956006999995, 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091422288000000004, 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22080 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969422+0000", 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969423+0000", 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4600000000000003e-07 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969426+0000", 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.01e-06 2024-09-14T07:13:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969429+0000", 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4729999999999999e-06 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060721+0000", 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091292124000000002 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060786+0000", 2024-09-14T07:13:44.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5321999999999996e-05 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060845+0000", 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999999e-05 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22082 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2048000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508946442999999, 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092203877000000004, 2024-09-14T07:13:44.548 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22082 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969432+0000", 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969433+0000", 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7100000000000011e-07 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969436+0000", 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8700000000000001e-06 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969438+0000", 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989999999999999e-06 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.060872+0000", 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.091433398999999999 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061574+0000", 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070248900000000004 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061636+0000", 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1620999999999998e-05 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22086 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1880064~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508937106999994, 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092360447999999998, 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.553 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22086 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969441+0000", 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969442+0000", 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.64e-07 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969446+0000", 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1980000000000001e-06 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969448+0000", 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4399999999999999e-06 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061663+0000", 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092214832999999996 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061735+0000", 2024-09-14T07:13:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1965000000000006e-05 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061802+0000", 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6820000000000001e-05 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22088 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1937408~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508926915000004, 2024-09-14T07:13:44.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092509267000000006, 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22088 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:44.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969451+0000", 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969452+0000", 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0899999999999997e-07 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969453+0000", 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4729999999999999e-06 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969459+0000", 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3400000000000003e-06 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969464+0000", 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5290000000000002e-06 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061828+0000", 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092364427999999998 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061896+0000", 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8099e-05 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061961+0000", 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4089000000000003e-05 2024-09-14T07:13:44.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22090 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 1994752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508906538000005, 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092645454000000002, 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.562 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22090 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969472+0000", 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299999999999998e-07 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969496+0000", 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3428e-05 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969505+0000", 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6490000000000003e-06 2024-09-14T07:13:44.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969509+0000", 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2390000000000004e-06 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.061987+0000", 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092477970000000007 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062054+0000", 2024-09-14T07:13:44.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6944000000000001e-05 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062117+0000", 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2841000000000004e-05 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4482.0:22092 3.8 3:17f69373:::rbd_data.11824d7f600c.0000000000000002:f [read 2052096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.508860494000004, 2024-09-14T07:13:44.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092757945999999994, 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4482", 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 22092 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969518+0000", 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.15e-07 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-14T07:13:44.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969520+0000", 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6190000000000001e-06 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969524+0000", 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4630000000000003e-06 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:16.969527+0000", 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.632e-06 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062141+0000", 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.092614309000000006 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062215+0000", 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3750000000000004e-05 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-14T07:12:17.062276+0000", 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0757999999999997e-05 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T07:13:44.571 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-14T07:13:44.571 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:13:44.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T07:13:44.687 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:44.687 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:44.687 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:44.687 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:44.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T07:13:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-09-14T07:13:44.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T07:13:44.801 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:44.802 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:44.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88270 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4423680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:44.916 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.569073543000002, 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074684924, 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88270 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345356+0000", 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345357+0000", 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5999999999999991e-07 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345361+0000", 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6669999999999998e-06 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345364+0000", 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6929999999999999e-06 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419699+0000", 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074334954999999994 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.419744+0000", 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5407000000000001e-05 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420041+0000", 2024-09-14T07:13:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029703599999999998 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88271 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 4751360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.569063094000001, 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074812980000000001, 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.921 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88271 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345367+0000", 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345368+0000", 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0729999999999999e-06 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345371+0000", 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7700000000000002e-06 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345373+0000", 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5280000000000002e-06 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420071+0000", 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074697801999999994 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420117+0000", 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.613e-05 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420180+0000", 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2467999999999999e-05 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88272 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5079040~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.925 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.569053140999998, 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074955248000000002, 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88272 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345377+0000", 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1500000000000001e-07 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345378+0000", 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345382+0000", 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6559999999999998e-06 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345384+0000", 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5790000000000002e-06 2024-09-14T07:13:44.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420216+0000", 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074831993999999999 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420270+0000", 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3390999999999998e-05 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420332+0000", 2024-09-14T07:13:44.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2379999999999996e-05 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88273 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5406720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.569042217000003, 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075081769000000007, 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.930 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88273 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:44.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345388+0000", 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345389+0000", 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1960000000000001e-06 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345392+0000", 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8720000000000002e-06 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345395+0000", 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420361+0000", 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074966675999999996 2024-09-14T07:13:44.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420407+0000", 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5974999999999999e-05 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420469+0000", 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1954999999999999e-05 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88274 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 5734400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.569031973999998, 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075196648000000005, 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88274 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.935 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345398+0000", 2024-09-14T07:13:44.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345399+0000", 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.043e-06 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345402+0000", 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1690000000000001e-06 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.345405+0000", 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.576e-06 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420497+0000", 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075091819000000004 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420540+0000", 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3071000000000001e-05 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.420595+0000", 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4762000000000002e-05 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88379 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4292608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.563086407999997, 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074785446000000005, 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.939 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88379 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351343+0000", 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351344+0000", 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4900000000000001e-07 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351346+0000", 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1550000000000001e-06 2024-09-14T07:13:44.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351352+0000", 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8510000000000004e-06 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351357+0000", 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4879999999999998e-06 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425793+0000", 2024-09-14T07:13:44.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074435912000000007 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.425842+0000", 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8746999999999999e-05 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426129+0000", 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028694400000000002 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.943 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88380 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4620288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.563065272999999, 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074868676999999995, 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88380 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.944 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351365+0000", 2024-09-14T07:13:44.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5999999999999999e-07 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351367+0000", 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9759999999999998e-06 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351373+0000", 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2179999999999996e-06 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351379+0000", 2024-09-14T07:13:44.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7810000000000002e-06 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426145+0000", 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074766049000000001 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426191+0000", 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6295000000000003e-05 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426233+0000", 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1998e-05 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88381 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 4947968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.563043778999997, 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074973930999999994, 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.948 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88381 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:44.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351386+0000", 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8500000000000002e-07 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351388+0000", 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9850000000000001e-06 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351395+0000", 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4189999999999999e-06 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351401+0000", 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7019999999999998e-06 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426258+0000", 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.074856961 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426313+0000", 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5423000000000001e-05 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426360+0000", 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7055999999999998e-05 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88382 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5275648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.952 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.563020751000003, 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075057970000000002, 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88382 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351409+0000", 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9499999999999998e-07 2024-09-14T07:13:44.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351412+0000", 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.21e-06 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351419+0000", 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1319999999999996e-06 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351425+0000", 2024-09-14T07:13:44.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7960000000000001e-06 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426386+0000", 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.07496121 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426429+0000", 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2908999999999999e-05 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426467+0000", 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8318000000000001e-05 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88383 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562999376, 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075158694999999998, 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.957 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88383 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351430+0000", 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351431+0000", 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.67e-07 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351432+0000", 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3990000000000001e-06 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351436+0000", 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0960000000000003e-06 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351439+0000", 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7240000000000001e-06 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426491+0000", 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075052147999999999 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426538+0000", 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7037999999999999e-05 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426589+0000", 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1023000000000003e-05 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88384 3.9 3:92193f49:::rbd_data.1182af6f1d9e.0000000000000002:1f [read 5931008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.961 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562987958000001, 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075251701000000004, 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88384 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351442+0000", 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3200000000000001e-07 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351447+0000", 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351451+0000", 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0249999999999996e-06 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351453+0000", 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7099999999999999e-06 2024-09-14T07:13:44.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426615+0000", 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075161760999999994 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426655+0000", 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0488000000000003e-05 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426694+0000", 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8089000000000001e-05 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88385 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562973356999997, 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075591572999999995, 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.966 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88385 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351456+0000", 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351457+0000", 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.36e-07 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351458+0000", 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0499999999999999e-06 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351461+0000", 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6260000000000001e-06 2024-09-14T07:13:44.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351464+0000", 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7159999999999999e-06 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426719+0000", 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075255296999999999 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.426765+0000", 2024-09-14T07:13:44.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5639000000000001e-05 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427048+0000", 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028300899999999997 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88386 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562962288999998, 2024-09-14T07:13:44.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075926868999999994, 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88386 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351468+0000", 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1799999999999999e-07 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351469+0000", 2024-09-14T07:13:44.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1319999999999999e-06 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351473+0000", 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8680000000000001e-06 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351475+0000", 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6850000000000001e-06 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427062+0000", 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075586286000000003 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427104+0000", 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2765999999999997e-05 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427394+0000", 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000289914 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.974 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88387 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 917504~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562951429000002, 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076267145999999994, 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.975 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88387 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351478+0000", 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351479+0000", 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1299999999999999e-07 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351480+0000", 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0210000000000001e-06 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351483+0000", 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3129999999999999e-06 2024-09-14T07:13:44.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351487+0000", 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5839999999999999e-06 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427423+0000", 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.075936836999999993 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427474+0000", 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.092e-05 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427746+0000", 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027125800000000002 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88388 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1245184~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:44.979 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562939409999998, 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076577049999999994, 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88388 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:44.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351490+0000", 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351491+0000", 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351492+0000", 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2699999999999999e-06 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351495+0000", 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7860000000000001e-06 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351497+0000", 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4739999999999999e-06 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427760+0000", 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076262515000000003 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.427804+0000", 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3912000000000002e-05 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428067+0000", 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000263885 2024-09-14T07:13:44.983 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88389 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1572864~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562929586999999, 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076920440000000007, 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.984 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88389 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351500+0000", 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351501+0000", 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0049999999999999e-06 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351509+0000", 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1149999999999996e-06 2024-09-14T07:13:44.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351512+0000", 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.118e-06 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428097+0000", 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076585768999999998 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428148+0000", 2024-09-14T07:13:44.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0560999999999999e-05 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428421+0000", 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027266299999999997 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88390 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 1900544~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562914859000003, 2024-09-14T07:13:44.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077201245000000002, 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88390 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351515+0000", 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7300000000000002e-07 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351516+0000", 2024-09-14T07:13:44.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1200000000000001e-06 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351519+0000", 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9550000000000001e-06 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351522+0000", 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.599e-06 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428434+0000", 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.076911733999999995 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428476+0000", 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2676999999999998e-05 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428716+0000", 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023978700000000001 2024-09-14T07:13:44.992 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88391 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2228224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562904731000003, 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077564510000000003, 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.993 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88391 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351525+0000", 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351526+0000", 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.071e-06 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351529+0000", 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7609999999999999e-06 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351532+0000", 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.638e-06 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428746+0000", 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077213853999999998 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.428797+0000", 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1153999999999998e-05 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429090+0000", 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00029282199999999998 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:88392 3.9 3:948f57e9:::rbd_data.1182af6f1d9e.0000000000000003:1f [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.562895177000001, 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077898167000000004, 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:44.997 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 88392 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.351535+0000", 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356945+0000", 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054103129999999999 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356949+0000", 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1949999999999996e-06 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:44.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356957+0000", 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.52e-06 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.356962+0000", 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0669999999999999e-06 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429120+0000", 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072157910000000006 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429166+0000", 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5998999999999998e-05 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:43.429433+0000", 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000267163 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89004 3.11 3:8cc22ccd:::rbd_data.11823480f600.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 16184667~39532] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:45.001 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.909125701000001, 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078160735999999995, 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89004 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005304+0000", 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.005306+0000", 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.114e-06 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021401+0000", 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.016094627 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021430+0000", 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8807e-05 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021458+0000", 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8087000000000001e-05 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021524+0000", 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6129000000000003e-05 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.021643+0000", 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011879699999999999 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.023151+0000", 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015083640000000001 2024-09-14T07:13:45.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.082911+0000", 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.059760412999999998 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083352+0000", 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044101699999999998 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083412+0000", 2024-09-14T07:13:45.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9305999999999998e-05 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.083465+0000", 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3075000000000003e-05 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.007 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T07:13:45.112 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.112 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:45.112 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:45.112 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T07:13:45.222 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.222 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:45.222 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:45.222 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:45.222 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T07:13:45.337 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:43707 3.1e 3:7c347745:::rbd_data.1182f9393092.0000000000000024:head [stat,delete] snapc 13=[13] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.478300211999994, 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.940517363, 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:45.338 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 43707 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856811+0000", 2024-09-14T07:13:45.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856813+0000", 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2970000000000002e-06 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856824+0000", 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0576e-05 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856858+0000", 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4023000000000003e-05 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856876+0000", 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8048999999999999e-05 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856962+0000", 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6510999999999999e-05 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:20.856974+0000", 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1372999999999999e-05 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794834+0000", 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.93786060599999999 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.794972+0000", 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013750599999999999 2024-09-14T07:13:45.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.795142+0000", 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016982400000000001 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.796064+0000", 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00092266099999999997 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797265+0000", 2024-09-14T07:13:45.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0012010689999999999 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797300+0000", 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4598999999999999e-05 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:21.797328+0000", 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8269e-05 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63708 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 169984~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521830041000001, 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075169, 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63708 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.345 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813281+0000", 2024-09-14T07:13:45.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0900000000000001e-07 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813282+0000", 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0380000000000001e-06 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813286+0000", 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.72e-06 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813288+0000", 2024-09-14T07:13:45.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.486e-06 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891108+0000", 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077819240999999997 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891161+0000", 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3279000000000003e-05 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891356+0000", 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019519599999999999 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63709 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 184320~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521819721, 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078323268000000001, 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.349 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63709 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813291+0000", 2024-09-14T07:13:45.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813292+0000", 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0200000000000001e-07 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813298+0000", 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6850000000000004e-06 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813303+0000", 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.254e-06 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813307+0000", 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1470000000000001e-06 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891382+0000", 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078075466999999996 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891432+0000", 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9617999999999998e-05 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891615+0000", 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000182895 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63710 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 198656~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.353 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521800744999993, 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078538839999999999, 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63710 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813310+0000", 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813311+0000", 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1400000000000001e-07 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813312+0000", 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0780000000000001e-06 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813316+0000", 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4780000000000002e-06 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813319+0000", 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.503e-06 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891637+0000", 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078318865000000001 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891685+0000", 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7834000000000003e-05 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891849+0000", 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016386800000000001 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.357 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63711 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 212992~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521789319999996, 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078778753000000007, 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.358 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63711 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813322+0000", 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2100000000000001e-07 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813323+0000", 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0979999999999999e-06 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813328+0000", 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5410000000000002e-06 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813330+0000", 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891874+0000", 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078543914000000006 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.891929+0000", 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4917999999999998e-05 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892100+0000", 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017145100000000001 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63712 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 227328~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521777823999997, 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078958750999999994, 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.362 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63712 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813333+0000", 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813334+0000", 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0330000000000001e-06 2024-09-14T07:13:45.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813337+0000", 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9610000000000001e-06 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813340+0000", 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.61e-06 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892124+0000", 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078784293000000005 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892168+0000", 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3748999999999997e-05 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892292+0000", 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012389700000000001 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63713 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 241664~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521766775000003, 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079199251999999998, 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.367 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63713 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813344+0000", 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0599999999999999e-07 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813346+0000", 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1149999999999999e-06 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813349+0000", 2024-09-14T07:13:45.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.134e-06 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813351+0000", 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6570000000000001e-06 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892316+0000", 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078964859999999998 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892364+0000", 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7580000000000002e-05 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892544+0000", 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0001797 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63714 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 256000~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:45.371 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521756460000006, 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079442656, 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63714 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:45.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813355+0000", 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813380+0000", 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5106e-05 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813381+0000", 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7570000000000001e-06 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813386+0000", 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4830000000000001e-06 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813389+0000", 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.179e-06 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892566+0000", 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079177343999999997 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892610+0000", 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3612000000000002e-05 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892797+0000", 2024-09-14T07:13:45.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018717500000000001 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63715 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 270336~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.521717206999995, 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079654894000000004, 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63715 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.813394+0000", 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819107+0000", 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057130899999999997 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819111+0000", 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.619e-06 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819119+0000", 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9369999999999993e-06 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819127+0000", 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9419999999999995e-06 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892820+0000", 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073692797000000004 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.892872+0000", 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2123000000000002e-05 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.893049+0000", 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000176386 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.380 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63730 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 485376~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.515822256999996, 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077828493999999998, 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63730 2024-09-14T07:13:45.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819289+0000", 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819290+0000", 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8000000000000004e-07 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819294+0000", 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9299999999999996e-06 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819297+0000", 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.695e-06 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896804+0000", 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077507978000000005 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.896886+0000", 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1135000000000002e-05 2024-09-14T07:13:45.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897117+0000", 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023167199999999999 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63731 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 499712~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.515811490999994, 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078091712999999993, 2024-09-14T07:13:45.385 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63731 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819300+0000", 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.04e-07 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819301+0000", 2024-09-14T07:13:45.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1900000000000001e-07 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819304+0000", 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7500000000000001e-06 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819307+0000", 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5440000000000001e-06 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897150+0000", 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077843252000000002 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897197+0000", 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6674000000000001e-05 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897391+0000", 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019437 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63732 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 514048~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.515801232000001, 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078414847999999995, 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.390 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63732 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819310+0000", 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.05e-07 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819311+0000", 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1119999999999999e-06 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819314+0000", 2024-09-14T07:13:45.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8909999999999999e-06 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819318+0000", 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.506e-06 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897424+0000", 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078106130999999995 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897512+0000", 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8094000000000001e-05 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897725+0000", 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000212909 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63733 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 528384~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:45.394 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.515790526000004, 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078659275000000001, 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63733 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819321+0000", 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:45.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819325+0000", 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8229999999999997e-06 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819328+0000", 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9319999999999998e-06 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819331+0000", 2024-09-14T07:13:45.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6979999999999998e-06 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897764+0000", 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078432460999999995 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897807+0000", 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3427999999999998e-05 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.897980+0000", 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017272500000000001 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63734 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 542720~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.515776759000005, 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078938423999999993, 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.399 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63734 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819334+0000", 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819335+0000", 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2399999999999999e-07 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819336+0000", 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.04e-06 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819339+0000", 2024-09-14T07:13:45.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7359999999999999e-06 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819342+0000", 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5409999999999999e-06 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898015+0000", 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078673329 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898103+0000", 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7466999999999995e-05 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898273+0000", 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000170087 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63735 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 557056~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.515766288999998, 2024-09-14T07:13:45.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079267997000000007, 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63735 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:45.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.819345+0000", 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825126+0000", 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057809560000000003 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825130+0000", 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0099999999999997e-06 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825139+0000", 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2920000000000001e-06 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825144+0000", 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9849999999999997e-06 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898308+0000", 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.073163658000000006 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898395+0000", 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7069000000000003e-05 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.898613+0000", 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000218027 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63750 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 772096~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.509811130000003, 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077901943000000001, 2024-09-14T07:13:45.408 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63750 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825300+0000", 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1e-07 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825301+0000", 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2720000000000001e-06 2024-09-14T07:13:45.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825304+0000", 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825307+0000", 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.977e-06 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902895+0000", 2024-09-14T07:13:45.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077587517999999994 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.902981+0000", 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5878999999999995e-05 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903202+0000", 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000221213 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63751 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 786432~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.509800757999997, 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078209331000000007, 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63751 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.414 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825310+0000", 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:45.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0800000000000001e-07 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825311+0000", 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7400000000000002e-07 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825315+0000", 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0409999999999999e-06 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825318+0000", 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.937e-06 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903248+0000", 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.077929183999999999 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903324+0000", 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6551999999999995e-05 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903520+0000", 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019553499999999999 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63752 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 800768~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.509789831000006, 2024-09-14T07:13:45.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078535403000000004, 2024-09-14T07:13:45.419 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.419 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.419 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.419 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63752 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825321+0000", 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2499999999999999e-07 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825322+0000", 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.031e-06 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825325+0000", 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9210000000000001e-06 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825328+0000", 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5160000000000001e-06 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903552+0000", 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078224361000000006 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903633+0000", 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1143999999999994e-05 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903857+0000", 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000223205 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.423 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:63753 3.1e 3:7c0cf15f:::rbd_data.11825f95f0cc.0000000000000000:1b [read 815104~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.509780276000001, 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.078794143999999997, 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 63753 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.825331+0000", 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830946+0000", 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056150760000000001 2024-09-14T07:13:45.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830950+0000", 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9779999999999999e-06 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830959+0000", 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5880000000000004e-06 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.830965+0000", 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2619999999999998e-06 2024-09-14T07:13:45.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903884+0000", 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.072919751000000005 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.903940+0000", 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5142000000000002e-05 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:35.904125+0000", 2024-09-14T07:13:45.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018534700000000001 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:89042 3.a 3:50a518e2:::rbd_data.11823480f600.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.191827584000002, 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.079514993000000006, 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.428 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 89042 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143283+0000", 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.143285+0000", 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8419999999999999e-06 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166345+0000", 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.023059606 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166371+0000", 2024-09-14T07:13:45.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6336999999999999e-05 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166384+0000", 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2429000000000001e-05 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166456+0000", 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2779000000000002e-05 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.166579+0000", 2024-09-14T07:13:45.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000122908 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.175320+0000", 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.008740523 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.220503+0000", 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.045183026000000001 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:45.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222718+0000", 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022151330000000002 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222762+0000", 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3621999999999997e-05 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:45.222798+0000", 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6788000000000001e-05 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.433 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.434 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.434 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.435 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T07:13:45.542 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.542 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:45.542 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:45.542 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T07:13:45.654 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.654 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:45.654 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:45.654 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:45.654 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4209.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.629483662, 2024-09-14T07:13:45.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66395165700000003, 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4209", 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/2619283118", 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 1 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134909+0000", 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134911+0000", 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4789999999999999e-06 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134918+0000", 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1130000000000003e-06 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134928+0000", 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0417e-05 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134938+0000", 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9809999999999998e-06 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.134999+0000", 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469000000000004e-05 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.135008+0000", 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.721e-06 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797223+0000", 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.66221459900000001 2024-09-14T07:13:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797434+0000", 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000211139 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.797613+0000", 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178815 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798741+0000", 2024-09-14T07:13:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011286289999999999 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798762+0000", 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1036999999999999e-05 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798822+0000", 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0025999999999998e-05 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:11:38.798861+0000", 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8232000000000003e-05 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:7773 3.d 3:b1737ed6:::rbd_object_map.1182a7d91484.0000000000000007:head [writefull 0~73] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 103.07416714, 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0081968690000001, 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 7773 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690226+0000", 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690227+0000", 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.035e-06 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690231+0000", 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3699999999999997e-06 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690241+0000", 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0190000000000001e-05 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690247+0000", 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4450000000000004e-06 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690299+0000", 2024-09-14T07:13:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1943000000000001e-05 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:02.690307+0000", 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3769999999999996e-06 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697367+0000", 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0070596860000001 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.697506+0000", 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013945 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698297+0000", 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00079062399999999997 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698350+0000", 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3001000000000003e-05 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:03.698422+0000", 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2748000000000002e-05 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21350 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1581056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853894242999999, 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067088444999999997, 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21350 2024-09-14T07:13:45.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910498+0000", 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910499+0000", 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5499999999999999e-07 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910500+0000", 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6750000000000001e-06 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910508+0000", 2024-09-14T07:13:45.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9230000000000002e-06 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910514+0000", 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3669999999999996e-06 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977374+0000", 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066860337000000006 2024-09-14T07:13:45.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977463+0000", 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8459000000000001e-05 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977587+0000", 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012432900000000001 2024-09-14T07:13:45.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21351 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1748992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853872551999999, 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067212639000000005, 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.785 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21351 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910520+0000", 2024-09-14T07:13:45.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910521+0000", 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0400000000000002e-07 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910522+0000", 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9290000000000001e-06 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910528+0000", 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7400000000000001e-06 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910533+0000", 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3390000000000003e-06 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977617+0000", 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067084486999999998 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977672+0000", 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5383000000000002e-05 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977733+0000", 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0356999999999998e-05 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.789 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21352 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1638400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853852649000004, 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067439900999999997, 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21352 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910540+0000", 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0699999999999998e-07 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910544+0000", 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3900000000000002e-06 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910550+0000", 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1469999999999998e-06 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910554+0000", 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5539999999999999e-06 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977773+0000", 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067218219999999995 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977859+0000", 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5853000000000006e-05 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.977980+0000", 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012142999999999999 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21353 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1806336~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:45.794 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853831154999995, 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563758000000002, 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21353 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910562+0000", 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0499999999999999e-07 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910564+0000", 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9580000000000001e-06 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910570+0000", 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.767e-06 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910574+0000", 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.656e-06 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978016+0000", 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067441741999999999 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978062+0000", 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6309e-05 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978125+0000", 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2921000000000003e-05 2024-09-14T07:13:45.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21354 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1695744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853812833999996, 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067708701999999996, 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.799 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21354 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910580+0000", 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.15e-07 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910582+0000", 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.728e-06 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910591+0000", 2024-09-14T07:13:45.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.346e-06 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910598+0000", 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9029999999999998e-06 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978161+0000", 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067563123000000003 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978214+0000", 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3158999999999997e-05 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978289+0000", 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4128000000000006e-05 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.803 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21356 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1753088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853786490999994, 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067803641999999997, 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.804 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21356 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910606+0000", 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910607+0000", 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0699999999999998e-07 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910609+0000", 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9750000000000001e-06 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910615+0000", 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1650000000000003e-06 2024-09-14T07:13:45.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910620+0000", 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8439999999999997e-06 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978312+0000", 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067692882999999995 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978353+0000", 2024-09-14T07:13:45.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0892000000000001e-05 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978410+0000", 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6475999999999999e-05 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21358 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1810432~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:45.808 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853766026000002, 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068032461000000002, 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21358 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910627+0000", 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5100000000000001e-07 2024-09-14T07:13:45.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910629+0000", 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.733e-06 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910634+0000", 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7209999999999999e-06 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910641+0000", 2024-09-14T07:13:45.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6390000000000003e-06 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978462+0000", 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067820662000000004 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978546+0000", 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4660999999999995e-05 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978659+0000", 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112694 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21363 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1585152~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853744171000002, 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068160198000000005, 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21363 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910649+0000", 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.84e-07 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910651+0000", 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.843e-06 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910657+0000", 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9100000000000002e-06 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910661+0000", 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7790000000000003e-06 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978700+0000", 2024-09-14T07:13:45.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068038653000000004 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978749+0000", 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8751999999999997e-05 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978809+0000", 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9877000000000003e-05 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21365 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1642496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853725535999999, 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068382583999999996, 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.818 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21365 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910667+0000", 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3999999999999997e-07 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910673+0000", 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2739999999999998e-06 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910680+0000", 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6639999999999998e-06 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910686+0000", 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8850000000000004e-06 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978839+0000", 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068152710000000005 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.978939+0000", 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9994999999999994e-05 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979050+0000", 2024-09-14T07:13:45.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000110716 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21367 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1699840~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853699395000007, 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068592897999999999, 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.826 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21367 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910693+0000", 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910694+0000", 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3799999999999998e-07 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910696+0000", 2024-09-14T07:13:45.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9829999999999999e-06 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910701+0000", 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4199999999999998e-06 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910712+0000", 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1243000000000001e-05 2024-09-14T07:13:45.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979088+0000", 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068376009000000001 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979175+0000", 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6643000000000004e-05 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979286+0000", 2024-09-14T07:13:45.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111162 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21368 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1589248~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853671876999996, 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068737492999999997, 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.831 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21368 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910721+0000", 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2899999999999999e-07 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910723+0000", 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.491e-06 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910727+0000", 2024-09-14T07:13:45.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7049999999999998e-06 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910730+0000", 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7499999999999999e-06 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979341+0000", 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068611215000000003 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979398+0000", 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6742e-05 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979458+0000", 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0260999999999998e-05 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21369 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1757184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.835 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853654398000003, 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068850514000000002, 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21369 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910738+0000", 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910739+0000", 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7000000000000001e-07 2024-09-14T07:13:45.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910740+0000", 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1489999999999999e-06 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910744+0000", 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2939999999999999e-06 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910747+0000", 2024-09-14T07:13:45.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1370000000000002e-06 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979488+0000", 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068740756 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979532+0000", 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4434999999999997e-05 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979589+0000", 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6473e-05 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21370 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1646592~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.853642281999996, 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.068974278999999999, 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21370 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.910750+0000", 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915942+0000", 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051918320000000004 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915946+0000", 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1189999999999999e-06 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915958+0000", 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1567e-05 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.915966+0000", 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1089999999999998e-06 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979614+0000", 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.063648423999999995 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979666+0000", 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1719999999999999e-05 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.979725+0000", 2024-09-14T07:13:45.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8508000000000003e-05 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21407 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1773568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.848200263999999, 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066870054999999998, 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.845 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21407 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916192+0000", 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916193+0000", 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9499999999999998e-07 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916194+0000", 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.559e-06 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916199+0000", 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0320000000000003e-06 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916205+0000", 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9939999999999997e-06 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.982957+0000", 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066751972000000007 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983005+0000", 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7982999999999998e-05 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983062+0000", 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7219999999999998e-05 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21408 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1605632~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.849 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.848180940000006, 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067010657000000001, 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21408 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916212+0000", 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4299999999999999e-07 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916214+0000", 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9530000000000002e-06 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916220+0000", 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0070000000000003e-06 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916225+0000", 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9019999999999998e-06 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983101+0000", 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.066875980000000002 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983165+0000", 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3779e-05 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983222+0000", 2024-09-14T07:13:45.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7692999999999998e-05 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21409 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1830912~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.848152089999999, 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067146749000000006, 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.854 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21409 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916241+0000", 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3099999999999998e-07 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916243+0000", 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3010000000000001e-06 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916253+0000", 2024-09-14T07:13:45.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7280000000000007e-06 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916259+0000", 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5809999999999996e-06 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983263+0000", 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067004523999999996 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983329+0000", 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6159000000000001e-05 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983387+0000", 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8025000000000001e-05 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21410 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1662976~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.858 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.848111566, 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067286991000000004, 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21410 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916281+0000", 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916282+0000", 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1600000000000001e-07 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916284+0000", 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5919999999999999e-06 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916292+0000", 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5259999999999996e-06 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916297+0000", 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3460000000000001e-06 2024-09-14T07:13:45.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983426+0000", 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067129216000000005 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983504+0000", 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7761000000000003e-05 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983568+0000", 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3934000000000001e-05 2024-09-14T07:13:45.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:21412 3.16 3:6c1821c8:::rbd_data.11824d7f600c.0000000000000001:f [read 1720320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.848089540999993, 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.067490834, 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:45.863 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 21412 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.916303+0000", 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:45.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921896+0000", 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055933179999999999 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921902+0000", 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7880000000000003e-06 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921912+0000", 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0152999999999999e-05 2024-09-14T07:13:45.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.921921+0000", 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4880000000000007e-06 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983604+0000", 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.061683011000000003 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983677+0000", 2024-09-14T07:13:45.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2988e-05 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:12:16.983794+0000", 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117088 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:45.867 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-09-14T07:13:45.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T07:13:45.972 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-14T07:13:45.972 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:45.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T07:13:46.083 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:46.083 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-14T07:13:46.083 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2024-09-14T07:13:46.083 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-14T07:13:46.084 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:46.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T07:13:46.195 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101015 3.5 3:a64521d3:::rbd_data.11821cead9c1.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.357360862999997, 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043484730000000003, 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101015 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836622+0000", 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836623+0000", 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-07 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836627+0000", 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3959999999999999e-06 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836636+0000", 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9449999999999999e-06 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836642+0000", 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2449999999999998e-06 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836695+0000", 2024-09-14T07:13:46.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3735e-05 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836826+0000", 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013094300000000001 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.836939+0000", 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112557 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.838008+0000", 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001068989 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840911+0000", 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029033010000000001 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840943+0000", 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1738e-05 2024-09-14T07:13:46.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:06.840971+0000", 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7885000000000002e-05 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3046 3.1f e87/85 3:ffa53dc0:::rbd_data.118239a42b07.0000000000000006:22 v 87'521, mlcod=86'518)", 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.393022076999998, 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045671549999999998, 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.202 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800961+0000", 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9099999999999999e-07 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800967+0000", 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8669999999999999e-06 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.800992+0000", 2024-09-14T07:13:46.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4555000000000001e-05 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801048+0000", 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6093e-05 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801219+0000", 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017133599999999999 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.801245+0000", 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5439000000000002e-05 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805483+0000", 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042387969999999999 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.805528+0000", 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4676999999999999e-05 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3047 3.17 e87/85 3:ea926012:::rbd_data.118239a42b07.000000000000000e:22 v 87'627, mlcod=84'624)", 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.389753696, 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037476889999999998, 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.207 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804229+0000", 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804230+0000", 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0750000000000001e-06 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804239+0000", 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9269999999999994e-06 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804252+0000", 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2679e-05 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804261+0000", 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7239999999999998e-06 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804348+0000", 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7134999999999998e-05 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.804374+0000", 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6288e-05 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807887+0000", 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035127589999999998 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:07.807977+0000", 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0101999999999999e-05 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.211 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101670 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.376728814000003, 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040111699999999997, 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.212 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101670 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817254+0000", 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817256+0000", 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7e-06 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817265+0000", 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1989999999999995e-06 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817280+0000", 2024-09-14T07:13:46.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4952e-05 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817288+0000", 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6879999999999999e-06 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817356+0000", 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7979999999999996e-05 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.817365+0000", 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2450000000000004e-06 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819318+0000", 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0019528499999999999 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819415+0000", 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7578999999999995e-05 2024-09-14T07:13:46.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.819804+0000", 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038904400000000001 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821059+0000", 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001254523 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821156+0000", 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.6824999999999995e-05 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821227+0000", 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1013000000000006e-05 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.821265+0000", 2024-09-14T07:13:46.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8572000000000003e-05 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101676 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [watch unwatch cookie 140170150085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.366025221000001, 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041592649999999997, 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.219 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101676 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827958+0000", 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4000000000000002e-07 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827961+0000", 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7769999999999998e-06 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827969+0000", 2024-09-14T07:13:46.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.089e-06 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.827975+0000", 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1e-06 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828225+0000", 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024990199999999998 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828309+0000", 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3647999999999996e-05 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828455+0000", 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014657200000000001 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829183+0000", 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00072760100000000003 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831875+0000", 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0026923089999999999 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.831958+0000", 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2164999999999997e-05 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832117+0000", 2024-09-14T07:13:46.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000159562 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101677 3.d 3:b520120b:::rbd_header.1182af6f1d9e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90)", 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 35.365718307999998, 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039841629999999998, 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-14T07:13:46.226 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101677 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828265+0000", 2024-09-14T07:13:46.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828266+0000", 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.001e-06 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828271+0000", 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3859999999999998e-06 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828282+0000", 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0868e-05 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828302+0000", 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0245e-05 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.828984+0000", 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068168600000000003 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for rw locks", 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.829038+0000", 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3732e-05 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832153+0000", 2024-09-14T07:13:46.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031149929999999999 2024-09-14T07:13:46.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832195+0000", 2024-09-14T07:13:46.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1853000000000001e-05 2024-09-14T07:13:46.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:10.832249+0000", 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4398999999999999e-05 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101893 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:46.233 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:46.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.367923623999999, 2024-09-14T07:13:46.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003596237, 2024-09-14T07:13:46.234 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.234 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.235 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.235 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101893 2024-09-14T07:13:46.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.235 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826059+0000", 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826062+0000", 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1289999999999999e-06 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826071+0000", 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0310000000000004e-06 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826093+0000", 2024-09-14T07:13:46.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2659000000000001e-05 2024-09-14T07:13:46.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826104+0000", 2024-09-14T07:13:46.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0379e-05 2024-09-14T07:13:46.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826226+0000", 2024-09-14T07:13:46.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012198500000000001 2024-09-14T07:13:46.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.826232+0000", 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.533e-06 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.827997+0000", 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017645689999999999 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828088+0000", 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1317999999999995e-05 2024-09-14T07:13:46.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.828266+0000", 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000178102 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829260+0000", 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00099377699999999994 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829563+0000", 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030319599999999999 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829617+0000", 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3384000000000003e-05 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.829656+0000", 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9174999999999997e-05 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.244 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:101988 3.2 3:40037cca:::rbd_object_map.118266971d4e:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.295824863999997, 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0059469579999999996, 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.245 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 101988 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898158+0000", 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898159+0000", 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1900000000000001e-07 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898163+0000", 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.675e-06 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898170+0000", 2024-09-14T07:13:46.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5279999999999998e-06 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898174+0000", 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1409999999999998e-06 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898209+0000", 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4301000000000002e-05 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898262+0000", 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3282999999999998e-05 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.898477+0000", 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000214606 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.899294+0000", 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00081715499999999996 2024-09-14T07:13:46.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904020+0000", 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047267430000000003 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904058+0000", 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7842000000000001e-05 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:11.904105+0000", 2024-09-14T07:13:46.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6864999999999999e-05 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102779 3.5 3:a1624695:::rbd_object_map.1182fc4f94db:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.531120434999998, 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041172270000000002, 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.251 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102779 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662863+0000", 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662864+0000", 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.578e-06 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662871+0000", 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8210000000000004e-06 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662884+0000", 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.324e-05 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662900+0000", 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526999999999999e-05 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.662966+0000", 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6024000000000003e-05 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663058+0000", 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1861999999999996e-05 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663178+0000", 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012068199999999999 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.663663+0000", 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00048430700000000001 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666909+0000", 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032459440000000002 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666944+0000", 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5748999999999999e-05 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.666980+0000", 2024-09-14T07:13:46.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5493000000000001e-05 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:102872 3.1c 3:3cb8b5e3:::rbd_data.1182fc4f94db.0000000000000011:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.469044286999999, 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036539760000000002, 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.257 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 102872 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:46.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724939+0000", 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2300000000000001e-07 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724946+0000", 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1090000000000003e-06 2024-09-14T07:13:46.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724954+0000", 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3920000000000003e-06 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.724960+0000", 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8599999999999998e-06 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725015+0000", 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5631999999999999e-05 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725096+0000", 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0519999999999995e-05 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.725197+0000", 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101277 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.726820+0000", 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001622343 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728502+0000", 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001682146 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728551+0000", 2024-09-14T07:13:46.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9644000000000001e-05 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:19.728593+0000", 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1430000000000001e-05 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103195 3.16 3:6f2974ce:::rbd_data.11823ead4c52.0000000000000005:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.468767192000001, 2024-09-14T07:13:46.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036435819999999998, 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103195 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:46.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725216+0000", 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725219+0000", 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8739999999999999e-06 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725244+0000", 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5142000000000001e-05 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725278+0000", 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4316999999999997e-05 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725306+0000", 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7392000000000001e-05 2024-09-14T07:13:46.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725384+0000", 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8385000000000003e-05 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725522+0000", 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013781199999999999 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.725636+0000", 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00011412399999999999 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726459+0000", 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082266499999999998 2024-09-14T07:13:46.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728790+0000", 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023316029999999998 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728831+0000", 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0329e-05 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.728859+0000", 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8938999999999999e-05 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4482.0:103194 3.1f e101/85 3:fedd7d60:::rbd_data.11823ead4c52.0000000000000004:head v 101'539, mlcod=95'536)", 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.467753326, 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036764279999999998, 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726230+0000", 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.41e-07 2024-09-14T07:13:46.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726234+0000", 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2189999999999998e-06 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726245+0000", 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0369e-05 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726256+0000", 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1829e-05 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726404+0000", 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014722199999999999 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.726425+0000", 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1605000000000001e-05 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729850+0000", 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003424739 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.729906+0000", 2024-09-14T07:13:46.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6203999999999999e-05 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:103218 3.1c 3:3e959835:::rbd_data.11823ead4c52.0000000000000033:head [delete] snapc 17=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:46.278 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 24.461610444000002, 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033495629999999998, 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 103218 2024-09-14T07:13:46.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732373+0000", 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732374+0000", 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1540000000000001e-06 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732378+0000", 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3279999999999999e-06 2024-09-14T07:13:46.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732390+0000", 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1717e-05 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732395+0000", 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.614e-06 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732451+0000", 2024-09-14T07:13:46.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5093999999999998e-05 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732578+0000", 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127269 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.732705+0000", 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000127627 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735416+0000", 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027103299999999999 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735625+0000", 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000209101 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735680+0000", 2024-09-14T07:13:46.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5634000000000003e-05 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:21.735722+0000", 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1695e-05 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(osd.0.0:3309 3.1f e105/85 3:f9a92dd7:::rbd_data.1182f9393092.00000000000000d1:13 v 105'545, mlcod=104'542)", 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:46.285 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 20.485754799999999, 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052652389999999997, 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708228+0000", 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708229+0000", 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6499999999999998e-07 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708235+0000", 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-06 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708250+0000", 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4440999999999999e-05 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708257+0000", 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7209999999999997e-06 2024-09-14T07:13:46.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708328+0000", 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1724000000000006e-05 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.708349+0000", 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0424e-05 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713448+0000", 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050992950000000002 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:25.713494+0000", 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5509000000000001e-05 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.290 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104289 3.1c 3:3852914e:::rbd_header.1182178f3240:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.541789884, 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039485689999999999, 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104289 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652193+0000", 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652195+0000", 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2180000000000002e-06 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652205+0000", 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7620000000000007e-06 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652295+0000", 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9728999999999994e-05 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652308+0000", 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2867999999999999e-05 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652584+0000", 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027594400000000003 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op must wait for map", 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.652592+0000", 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0579999999999998e-06 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653791+0000", 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001199706 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.653864+0000", 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2894999999999999e-05 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.654253+0000", 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038851199999999998 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.655493+0000", 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001239995 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656020+0000", 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000526999 2024-09-14T07:13:46.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656079+0000", 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8711000000000001e-05 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.656142+0000", 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3171999999999998e-05 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104384 3.2 3:41c285d9:::rbd_data.1182178f3240.0000000000000194:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.46171489, 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055148419999999998, 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104384 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732268+0000", 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732269+0000", 2024-09-14T07:13:46.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0400000000000005e-07 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732273+0000", 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0640000000000004e-06 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732285+0000", 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1419e-05 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732290+0000", 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.366e-06 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732366+0000", 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6144999999999997e-05 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732493+0000", 2024-09-14T07:13:46.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000126573 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732595+0000", 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102845 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733197+0000", 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060171300000000003 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737707+0000", 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045098689999999997 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737755+0000", 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7596000000000003e-05 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.737783+0000", 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8348e-05 2024-09-14T07:13:46.303 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104385 3.16 3:6c6b45b7:::rbd_data.1182178f3240.0000000000000195:head [delete] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 17.461676446999999, 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.004426269, 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.304 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104385 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732307+0000", 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732310+0000", 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4370000000000001e-06 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732319+0000", 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2580000000000001e-06 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732324+0000", 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3929999999999999e-06 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732375+0000", 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0909000000000003e-05 2024-09-14T07:13:46.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732449+0000", 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4173999999999998e-05 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.732509+0000", 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9630999999999999e-05 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.733010+0000", 2024-09-14T07:13:46.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050073999999999995 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736671+0000", 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036615300000000001 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736703+0000", 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1287e-05 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:28.736733+0000", 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0335e-05 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:104553 3.1d 3:ba01ca6b:::rbd_data.11824d7f600c.0000000000000005:head [delete] snapc f=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 16.411557572, 2024-09-14T07:13:46.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.947483572, 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 104553 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782425+0000", 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782426+0000", 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2e-07 2024-09-14T07:13:46.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782428+0000", 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2299999999999998e-06 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782435+0000", 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5200000000000003e-06 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782441+0000", 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.173e-06 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782489+0000", 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7692999999999999e-05 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for peered", 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:29.782497+0000", 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2309999999999996e-06 2024-09-14T07:13:46.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728308+0000", 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.94581115100000002 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728457+0000", 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014953300000000001 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 2", 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.728621+0000", 2024-09-14T07:13:46.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016359 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729779+0000", 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011581880000000001 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729799+0000", 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0112999999999999e-05 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729855+0000", 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5513999999999997e-05 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:30.729909+0000", 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4215999999999997e-05 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:106687 3.5 3:a1e6b2b0:::rbd_data.1182f1e71464.000000000000000a:head [delete] snapc 3=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-14T07:13:46.317 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:42.713536+0000", 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.4804472839999998, 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032502910000000002, 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 106687 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713536+0000", 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713536+0000", 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713536+0000", 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1300000000000001e-07 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713537+0000", 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3740000000000001e-06 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713550+0000", 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2748999999999999e-05 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713553+0000", 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0510000000000001e-06 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713597+0000", 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3908e-05 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713770+0000", 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017247599999999999 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713872+0000", 2024-09-14T07:13:46.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010249 2024-09-14T07:13:46.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.714547+0000", 2024-09-14T07:13:46.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067523300000000002 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.716703+0000", 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021557049999999999 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.716749+0000", 2024-09-14T07:13:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6017999999999999e-05 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.716786+0000", 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6974000000000002e-05 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(client.4482.0:106690 3.c 3:3701356a:::rbd_data.1182f1e71464.0000000000000011:head [delete] snapc 3=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-14T07:13:42.713567+0000", 2024-09-14T07:13:46.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 3.4804156219999998, 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035742619999999999, 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "continuous": false, 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client_info": { 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client": "client.4482", 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "client_addr": "172.21.15.71:0/258259318", 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 106690 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-14T07:13:46.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713567+0000", 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713567+0000", 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713568+0000", 2024-09-14T07:13:46.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.7599999999999997e-07 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713570+0000", 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.396e-06 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713575+0000", 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0980000000000001e-06 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.713584+0000", 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2120000000000003e-06 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.715013+0000", 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014291849999999999 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.715168+0000", 2024-09-14T07:13:46.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000155422 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.715239+0000", 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1231999999999998e-05 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.716540+0000", 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00130083 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.717080+0000", 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00053943899999999996 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.717108+0000", 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8231000000000001e-05 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-14T07:13:42.717142+0000", 2024-09-14T07:13:46.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3741000000000001e-05 2024-09-14T07:13:46.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-14T07:13:46.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-14T07:13:46.331 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-14T07:13:46.673 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-14T07:13:46.673 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-14T07:13:46.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-14T07:13:46.980 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-09-14T07:13:46.979+0000 7fe4a9aff640 -1 mon.a@0(leader).osd e125 definitely_dead 0 2024-09-14T07:13:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:marked in osd.7. 2024-09-14T07:13:47.823 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-14T07:13:47.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-14T07:13:47.938 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a: {} 2024-09-14T07:13:47.939 INFO:teuthology.orchestra.run.smithi071.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T07:13:47.948 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b: {} 2024-09-14T07:13:47.948 INFO:teuthology.orchestra.run.smithi071.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T07:13:47.956 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c: {} 2024-09-14T07:13:47.956 INFO:teuthology.orchestra.run.smithi071.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T07:13:47.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T07:13:48.809 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T07:13:48.827 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-14T07:13:49.807 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-14T07:13:49.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T07:13:50.838 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T07:13:50.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-14T07:13:51.651 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-14T07:13:51.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T07:13:52.835 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T07:13:52.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-14T07:13:53.852 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-14T07:13:53.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T07:13:54.851 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T07:13:54.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-14T07:13:55.863 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-14T07:13:55.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T07:13:56.870 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T07:13:56.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-14T07:13:57.873 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-14T07:13:57.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T07:13:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T07:13:58.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-14T07:13:59.899 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-14T07:13:59.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-14T07:14:00.910 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.7 to 1 (10000) 2024-09-14T07:14:00.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-14T07:14:01.908 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-14T07:14:01.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T07:14:02.913 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T07:14:02.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-14T07:14:03.924 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-14T07:14:03.940 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-14T07:14:03.940 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-14T07:14:03.940 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-14T07:14:03.940 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-14T07:14:03.941 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T07:14:03.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T07:14:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:04.226 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":142,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:14:03.920018+0000","last_up_change":"2024-09-14T07:13:02.742048+0000","last_in_change":"2024-09-14T07:13:47.800544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T07:11:36.356620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T07:11:40.724021+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T07:11:50.672481+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":39,"snap_epoch":122,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889617493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889617493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6829","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6831","nonce":2889617493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6825","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6827","nonce":2889617493}]},"public_addr":"172.21.15.71:6819/2889617493","cluster_addr":"172.21.15.71:6823/2889617493","heartbeat_back_addr":"172.21.15.71:6831/2889617493","heartbeat_front_addr":"172.21.15.71:6827/2889617493","state":["exists","up"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6803","nonce":3955072152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6805","nonce":3955072152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6809","nonce":3955072152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6807","nonce":3955072152}]},"public_addr":"172.21.15.71:6803/3955072152","cluster_addr":"172.21.15.71:6805/3955072152","heartbeat_back_addr":"172.21.15.71:6809/3955072152","heartbeat_front_addr":"172.21.15.71:6807/3955072152","state":["exists","up"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6822","nonce":3066758971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6826","nonce":3066758971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6833","nonce":3066758971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6830","nonce":3066758971}]},"public_addr":"172.21.15.71:6822/3066758971","cluster_addr":"172.21.15.71:6826/3066758971","heartbeat_back_addr":"172.21.15.71:6833/3066758971","heartbeat_front_addr":"172.21.15.71:6830/3066758971","state":["exists","up"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6811","nonce":1876512586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6813","nonce":1876512586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6817","nonce":1876512586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6815","nonce":1876512586}]},"public_addr":"172.21.15.71:6811/1876512586","cluster_addr":"172.21.15.71:6813/1876512586","heartbeat_back_addr":"172.21.15.71:6817/1876512586","heartbeat_front_addr":"172.21.15.71:6815/1876512586","state":["exists","up"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6817","nonce":1898851107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6819","nonce":1898851107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6823","nonce":1898851107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6821","nonce":1898851107}]},"public_addr":"172.21.15.86:6817/1898851107","cluster_addr":"172.21.15.86:6819/1898851107","heartbeat_back_addr":"172.21.15.86:6823/1898851107","heartbeat_front_addr":"172.21.15.86:6821/1898851107","state":["exists","up"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":32,"up_from":82,"up_thru":129,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6825","nonce":708849283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6827","nonce":708849283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6831","nonce":708849283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6829","nonce":708849283}]},"public_addr":"172.21.15.86:6825/708849283","cluster_addr":"172.21.15.86:6827/708849283","heartbeat_back_addr":"172.21.15.86:6831/708849283","heartbeat_front_addr":"172.21.15.86:6829/708849283","state":["exists","up"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6809","nonce":1465682528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6811","nonce":1465682528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6815","nonce":1465682528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6813","nonce":1465682528}]},"public_addr":"172.21.15.86:6809/1465682528","cluster_addr":"172.21.15.86:6811/1465682528","heartbeat_back_addr":"172.21.15.86:6815/1465682528","heartbeat_front_addr":"172.21.15.86:6813/1465682528","state":["exists","up"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6801","nonce":2849091451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6803","nonce":2849091451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6807","nonce":2849091451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6805","nonce":2849091451}]},"public_addr":"172.21.15.86:6801/2849091451","cluster_addr":"172.21.15.86:6803/2849091451","heartbeat_back_addr":"172.21.15.86:6807/2849091451","heartbeat_front_addr":"172.21.15.86:6805/2849091451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.746971+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.202992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:32.026889+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.140575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.188928+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.701967+0000","dead_epoch":33},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.242666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.149131+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.12","osds":[7,4]}],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:14:04.239 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T07:14:04.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T07:14:04.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:04.527 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":142,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:14:03.920018+0000","last_up_change":"2024-09-14T07:13:02.742048+0000","last_in_change":"2024-09-14T07:13:47.800544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T07:11:36.356620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T07:11:40.724021+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T07:11:50.672481+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":39,"snap_epoch":122,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889617493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889617493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6829","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6831","nonce":2889617493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6825","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6827","nonce":2889617493}]},"public_addr":"172.21.15.71:6819/2889617493","cluster_addr":"172.21.15.71:6823/2889617493","heartbeat_back_addr":"172.21.15.71:6831/2889617493","heartbeat_front_addr":"172.21.15.71:6827/2889617493","state":["exists","up"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6803","nonce":3955072152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6805","nonce":3955072152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6809","nonce":3955072152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6807","nonce":3955072152}]},"public_addr":"172.21.15.71:6803/3955072152","cluster_addr":"172.21.15.71:6805/3955072152","heartbeat_back_addr":"172.21.15.71:6809/3955072152","heartbeat_front_addr":"172.21.15.71:6807/3955072152","state":["exists","up"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6822","nonce":3066758971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6826","nonce":3066758971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6833","nonce":3066758971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6830","nonce":3066758971}]},"public_addr":"172.21.15.71:6822/3066758971","cluster_addr":"172.21.15.71:6826/3066758971","heartbeat_back_addr":"172.21.15.71:6833/3066758971","heartbeat_front_addr":"172.21.15.71:6830/3066758971","state":["exists","up"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6811","nonce":1876512586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6813","nonce":1876512586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6817","nonce":1876512586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6815","nonce":1876512586}]},"public_addr":"172.21.15.71:6811/1876512586","cluster_addr":"172.21.15.71:6813/1876512586","heartbeat_back_addr":"172.21.15.71:6817/1876512586","heartbeat_front_addr":"172.21.15.71:6815/1876512586","state":["exists","up"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6817","nonce":1898851107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6819","nonce":1898851107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6823","nonce":1898851107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6821","nonce":1898851107}]},"public_addr":"172.21.15.86:6817/1898851107","cluster_addr":"172.21.15.86:6819/1898851107","heartbeat_back_addr":"172.21.15.86:6823/1898851107","heartbeat_front_addr":"172.21.15.86:6821/1898851107","state":["exists","up"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":32,"up_from":82,"up_thru":129,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6825","nonce":708849283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6827","nonce":708849283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6831","nonce":708849283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6829","nonce":708849283}]},"public_addr":"172.21.15.86:6825/708849283","cluster_addr":"172.21.15.86:6827/708849283","heartbeat_back_addr":"172.21.15.86:6831/708849283","heartbeat_front_addr":"172.21.15.86:6829/708849283","state":["exists","up"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6809","nonce":1465682528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6811","nonce":1465682528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6815","nonce":1465682528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6813","nonce":1465682528}]},"public_addr":"172.21.15.86:6809/1465682528","cluster_addr":"172.21.15.86:6811/1465682528","heartbeat_back_addr":"172.21.15.86:6815/1465682528","heartbeat_front_addr":"172.21.15.86:6813/1465682528","state":["exists","up"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6801","nonce":2849091451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6803","nonce":2849091451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6807","nonce":2849091451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6805","nonce":2849091451}]},"public_addr":"172.21.15.86:6801/2849091451","cluster_addr":"172.21.15.86:6803/2849091451","heartbeat_back_addr":"172.21.15.86:6807/2849091451","heartbeat_front_addr":"172.21.15.86:6805/2849091451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.746971+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.202992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:32.026889+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.140575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.188928+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.701967+0000","dead_epoch":33},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.242666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.149131+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.12","osds":[7,4]}],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:14:04.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T07:14:04.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T07:14:04.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T07:14:04.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T07:14:04.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T07:14:04.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T07:14:04.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T07:14:04.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T07:14:04.785 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:04.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T07:14:04.786 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:04.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T07:14:04.788 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:04.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T07:14:04.789 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:04.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T07:14:04.790 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:04.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T07:14:04.791 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:04.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T07:14:04.792 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:04.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T07:14:04.793 INFO:teuthology.orchestra.run.smithi071.stdout:352187318286 2024-09-14T07:14:04.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T07:14:05.433 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:05.433 INFO:teuthology.orchestra.run.smithi071.stdout:60129542177 2024-09-14T07:14:05.440 INFO:teuthology.orchestra.run.smithi071.stdout:60129542176 2024-09-14T07:14:05.443 INFO:teuthology.orchestra.run.smithi071.stdout:352187318285 2024-09-14T07:14:05.445 INFO:teuthology.orchestra.run.smithi071.stdout:60129542176 2024-09-14T07:14:05.447 INFO:teuthology.orchestra.run.smithi071.stdout:60129542176 2024-09-14T07:14:05.450 INFO:teuthology.orchestra.run.smithi071.stdout:60129542176 2024-09-14T07:14:05.455 INFO:teuthology.orchestra.run.smithi071.stdout:60129542176 2024-09-14T07:14:05.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.6 2024-09-14T07:14:05.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.4 2024-09-14T07:14:05.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.3 2024-09-14T07:14:05.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 352187318286 got 352187318285 for osd.5 2024-09-14T07:14:05.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.1 2024-09-14T07:14:05.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.7 2024-09-14T07:14:05.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.0 2024-09-14T07:14:05.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.2 2024-09-14T07:14:06.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T07:14:06.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T07:14:06.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T07:14:06.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T07:14:06.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T07:14:06.472 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T07:14:06.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T07:14:06.480 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T07:14:07.054 INFO:teuthology.orchestra.run.smithi071.stdout:60129542179 2024-09-14T07:14:07.065 INFO:teuthology.orchestra.run.smithi071.stdout:60129542179 2024-09-14T07:14:07.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542179 for osd.6 2024-09-14T07:14:07.075 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542179 for osd.4 2024-09-14T07:14:07.085 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.100 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:07.100 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:07.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542178 for osd.0 2024-09-14T07:14:07.119 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542178 for osd.3 2024-09-14T07:14:07.119 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.127 INFO:teuthology.orchestra.run.smithi071.stdout:352187318286 2024-09-14T07:14:07.127 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:07.130 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:07.137 INFO:teuthology.orchestra.run.smithi071.stdout:60129542178 2024-09-14T07:14:07.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 352187318286 got 352187318286 for osd.5 2024-09-14T07:14:07.144 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542178 for osd.1 2024-09-14T07:14:07.149 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542178 for osd.7 2024-09-14T07:14:07.150 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542178 for osd.2 2024-09-14T07:14:07.152 DEBUG:teuthology.parallel:result is None 2024-09-14T07:14:07.152 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T07:14:07.153 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:07.475 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:07.475 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:07.486 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-14T07:14:06.368089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15967,"ondisk_log_size":15967,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358400,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616320,"statfs":{"total":773094113280,"available":772727111680,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-525,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460020"},"pg_stats":[{"pgid":"3.1f","version":"122'603","reported_seq":4720,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936178+0000","last_change":"2024-09-14T07:13:42.659658+0000","last_active":"2024-09-14T07:14:03.936178+0000","last_peered":"2024-09-14T07:14:03.936178+0000","last_clean":"2024-09-14T07:14:03.936178+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:03.936178+0000","last_undegraded":"2024-09-14T07:14:03.936178+0000","last_fullsized":"2024-09-14T07:14:03.936178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:41.983378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"122'300","reported_seq":4448,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927639+0000","last_change":"2024-09-14T07:13:56.875330+0000","last_active":"2024-09-14T07:14:03.927639+0000","last_peered":"2024-09-14T07:14:03.927639+0000","last_clean":"2024-09-14T07:14:03.927639+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:03.927639+0000","last_undegraded":"2024-09-14T07:14:03.927639+0000","last_fullsized":"2024-09-14T07:14:03.927639+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:14.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"121'240","reported_seq":2227,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936220+0000","last_change":"2024-09-14T07:13:42.662042+0000","last_active":"2024-09-14T07:14:03.936220+0000","last_peered":"2024-09-14T07:14:03.936220+0000","last_clean":"2024-09-14T07:14:03.936220+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:03.936220+0000","last_undegraded":"2024-09-14T07:14:03.936220+0000","last_fullsized":"2024-09-14T07:14:03.936220+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:26.267442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"122'570","reported_seq":2495,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936103+0000","last_change":"2024-09-14T07:13:42.661448+0000","last_active":"2024-09-14T07:14:03.936103+0000","last_peered":"2024-09-14T07:14:03.936103+0000","last_clean":"2024-09-14T07:14:03.936103+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:03.936103+0000","last_undegraded":"2024-09-14T07:14:03.936103+0000","last_fullsized":"2024-09-14T07:14:03.936103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:05.161859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"119'280","reported_seq":2959,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936038+0000","last_change":"2024-09-14T07:13:42.659334+0000","last_active":"2024-09-14T07:14:03.936038+0000","last_peered":"2024-09-14T07:14:03.936038+0000","last_clean":"2024-09-14T07:14:03.936038+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:03.936038+0000","last_undegraded":"2024-09-14T07:14:03.936038+0000","last_fullsized":"2024-09-14T07:14:03.936038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:47.800369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"122'707","reported_seq":3855,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.654278+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:23.271059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"122'372","reported_seq":5306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928415+0000","last_change":"2024-09-14T07:13:42.655549+0000","last_active":"2024-09-14T07:14:03.928415+0000","last_peered":"2024-09-14T07:14:03.928415+0000","last_clean":"2024-09-14T07:14:03.928415+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:03.928415+0000","last_undegraded":"2024-09-14T07:14:03.928415+0000","last_fullsized":"2024-09-14T07:14:03.928415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:22.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"118'448","reported_seq":2963,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927393+0000","last_change":"2024-09-14T07:13:56.873416+0000","last_active":"2024-09-14T07:14:03.927393+0000","last_peered":"2024-09-14T07:14:03.927393+0000","last_clean":"2024-09-14T07:14:03.927393+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:03.927393+0000","last_undegraded":"2024-09-14T07:14:03.927393+0000","last_fullsized":"2024-09-14T07:14:03.927393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:37.420626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'724","reported_seq":8332,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936104+0000","last_change":"2024-09-14T07:13:42.659869+0000","last_active":"2024-09-14T07:14:03.936104+0000","last_peered":"2024-09-14T07:14:03.936104+0000","last_clean":"2024-09-14T07:14:03.936104+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:03.936104+0000","last_undegraded":"2024-09-14T07:14:03.936104+0000","last_fullsized":"2024-09-14T07:14:03.936104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.346643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'497","reported_seq":2948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936288+0000","last_change":"2024-09-14T07:13:51.661839+0000","last_active":"2024-09-14T07:14:03.936288+0000","last_peered":"2024-09-14T07:14:03.936288+0000","last_clean":"2024-09-14T07:14:03.936288+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:03.936288+0000","last_undegraded":"2024-09-14T07:14:03.936288+0000","last_fullsized":"2024-09-14T07:14:03.936288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:20.440426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"121'375","reported_seq":1646,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937196+0000","last_change":"2024-09-14T07:14:02.918531+0000","last_active":"2024-09-14T07:14:03.937196+0000","last_peered":"2024-09-14T07:14:03.937196+0000","last_clean":"2024-09-14T07:14:03.937196+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:03.937196+0000","last_undegraded":"2024-09-14T07:14:03.937196+0000","last_fullsized":"2024-09-14T07:14:03.937196+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:48.617880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"120'776","reported_seq":4171,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936736+0000","last_change":"2024-09-14T07:13:51.658453+0000","last_active":"2024-09-14T07:14:03.936736+0000","last_peered":"2024-09-14T07:14:03.936736+0000","last_clean":"2024-09-14T07:14:03.936736+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:03.936736+0000","last_undegraded":"2024-09-14T07:14:03.936736+0000","last_fullsized":"2024-09-14T07:14:03.936736+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:02.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926067+0000","last_change":"2024-09-14T07:13:48.816202+0000","last_active":"2024-09-14T07:14:03.926067+0000","last_peered":"2024-09-14T07:14:03.926067+0000","last_clean":"2024-09-14T07:14:03.926067+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:03.926067+0000","last_undegraded":"2024-09-14T07:14:03.926067+0000","last_fullsized":"2024-09-14T07:14:03.926067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:27.820087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'886","reported_seq":4532,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936035+0000","last_change":"2024-09-14T07:13:42.659395+0000","last_active":"2024-09-14T07:14:03.936035+0000","last_peered":"2024-09-14T07:14:03.936035+0000","last_clean":"2024-09-14T07:14:03.936035+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:03.936035+0000","last_undegraded":"2024-09-14T07:14:03.936035+0000","last_fullsized":"2024-09-14T07:14:03.936035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:20.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928557+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:14:03.928557+0000","last_peered":"2024-09-14T07:14:03.928557+0000","last_clean":"2024-09-14T07:14:03.928557+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:03.928557+0000","last_undegraded":"2024-09-14T07:14:03.928557+0000","last_fullsized":"2024-09-14T07:14:03.928557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5208,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927827+0000","last_change":"2024-09-14T07:13:51.660705+0000","last_active":"2024-09-14T07:14:03.927827+0000","last_peered":"2024-09-14T07:14:03.927827+0000","last_clean":"2024-09-14T07:14:03.927827+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:03.927827+0000","last_undegraded":"2024-09-14T07:14:03.927827+0000","last_fullsized":"2024-09-14T07:14:03.927827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:31.879849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937307+0000","last_change":"2024-09-14T07:14:02.917771+0000","last_active":"2024-09-14T07:14:03.937307+0000","last_peered":"2024-09-14T07:14:03.937307+0000","last_clean":"2024-09-14T07:14:03.937307+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:03.937307+0000","last_undegraded":"2024-09-14T07:14:03.937307+0000","last_fullsized":"2024-09-14T07:14:03.937307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:30.994939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'979","reported_seq":5213,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928530+0000","last_change":"2024-09-14T07:13:42.655908+0000","last_active":"2024-09-14T07:14:03.928530+0000","last_peered":"2024-09-14T07:14:03.928530+0000","last_clean":"2024-09-14T07:14:03.928530+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:03.928530+0000","last_undegraded":"2024-09-14T07:14:03.928530+0000","last_fullsized":"2024-09-14T07:14:03.928530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:38.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928589+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:14:03.928589+0000","last_peered":"2024-09-14T07:14:03.928589+0000","last_clean":"2024-09-14T07:14:03.928589+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:03.928589+0000","last_undegraded":"2024-09-14T07:14:03.928589+0000","last_fullsized":"2024-09-14T07:14:03.928589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"122'549","reported_seq":1466,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936224+0000","last_change":"2024-09-14T07:13:42.661444+0000","last_active":"2024-09-14T07:14:03.936224+0000","last_peered":"2024-09-14T07:14:03.936224+0000","last_clean":"2024-09-14T07:14:03.936224+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:03.936224+0000","last_undegraded":"2024-09-14T07:14:03.936224+0000","last_fullsized":"2024-09-14T07:14:03.936224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:05.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'487","reported_seq":2978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936676+0000","last_change":"2024-09-14T07:13:42.655476+0000","last_active":"2024-09-14T07:14:03.936676+0000","last_peered":"2024-09-14T07:14:03.936676+0000","last_clean":"2024-09-14T07:14:03.936676+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:03.936676+0000","last_undegraded":"2024-09-14T07:14:03.936676+0000","last_fullsized":"2024-09-14T07:14:03.936676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.098950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":157,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936078+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:14:03.936078+0000","last_peered":"2024-09-14T07:14:03.936078+0000","last_clean":"2024-09-14T07:14:03.936078+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:03.936078+0000","last_undegraded":"2024-09-14T07:14:03.936078+0000","last_fullsized":"2024-09-14T07:14:03.936078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'303","reported_seq":4458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928377+0000","last_change":"2024-09-14T07:13:42.656092+0000","last_active":"2024-09-14T07:14:03.928377+0000","last_peered":"2024-09-14T07:14:03.928377+0000","last_clean":"2024-09-14T07:14:03.928377+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:03.928377+0000","last_undegraded":"2024-09-14T07:14:03.928377+0000","last_fullsized":"2024-09-14T07:14:03.928377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:21.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936166+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:14:03.936166+0000","last_peered":"2024-09-14T07:14:03.936166+0000","last_clean":"2024-09-14T07:14:03.936166+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:03.936166+0000","last_undegraded":"2024-09-14T07:14:03.936166+0000","last_fullsized":"2024-09-14T07:14:03.936166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3509,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.935839+0000","last_change":"2024-09-14T07:13:42.658428+0000","last_active":"2024-09-14T07:14:03.935839+0000","last_peered":"2024-09-14T07:14:03.935839+0000","last_clean":"2024-09-14T07:14:03.935839+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:03.935839+0000","last_undegraded":"2024-09-14T07:14:03.935839+0000","last_fullsized":"2024-09-14T07:14:03.935839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937047+0000","last_change":"2024-09-14T07:14:02.915265+0000","last_active":"2024-09-14T07:14:03.937047+0000","last_peered":"2024-09-14T07:14:03.937047+0000","last_clean":"2024-09-14T07:14:03.937047+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:03.937047+0000","last_undegraded":"2024-09-14T07:14:03.937047+0000","last_fullsized":"2024-09-14T07:14:03.937047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:21.271822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"121'333","reported_seq":1925,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927505+0000","last_change":"2024-09-14T07:13:56.872552+0000","last_active":"2024-09-14T07:14:03.927505+0000","last_peered":"2024-09-14T07:14:03.927505+0000","last_clean":"2024-09-14T07:14:03.927505+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:03.927505+0000","last_undegraded":"2024-09-14T07:14:03.927505+0000","last_fullsized":"2024-09-14T07:14:03.927505+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:01.375496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936090+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:14:03.936090+0000","last_peered":"2024-09-14T07:14:03.936090+0000","last_clean":"2024-09-14T07:14:03.936090+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:03.936090+0000","last_undegraded":"2024-09-14T07:14:03.936090+0000","last_fullsized":"2024-09-14T07:14:03.936090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":294,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937174+0000","last_change":"2024-09-14T07:14:02.917799+0000","last_active":"2024-09-14T07:14:03.937174+0000","last_peered":"2024-09-14T07:14:03.937174+0000","last_clean":"2024-09-14T07:14:03.937174+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:03.937174+0000","last_undegraded":"2024-09-14T07:14:03.937174+0000","last_fullsized":"2024-09-14T07:14:03.937174+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:01.507093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'475","reported_seq":3452,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927463+0000","last_change":"2024-09-14T07:13:42.717368+0000","last_active":"2024-09-14T07:14:03.927463+0000","last_peered":"2024-09-14T07:14:03.927463+0000","last_clean":"2024-09-14T07:14:03.927463+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:03.927463+0000","last_undegraded":"2024-09-14T07:14:03.927463+0000","last_fullsized":"2024-09-14T07:14:03.927463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:44.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"122'550","reported_seq":4562,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.653572+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:53.560867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"121'416","reported_seq":2315,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926068+0000","last_change":"2024-09-14T07:13:42.663426+0000","last_active":"2024-09-14T07:14:03.926068+0000","last_peered":"2024-09-14T07:14:03.926068+0000","last_clean":"2024-09-14T07:14:03.926068+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:03.926068+0000","last_undegraded":"2024-09-14T07:14:03.926068+0000","last_fullsized":"2024-09-14T07:14:03.926068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:59.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"121'301","reported_seq":2781,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927575+0000","last_change":"2024-09-14T07:13:56.874425+0000","last_active":"2024-09-14T07:14:03.927575+0000","last_peered":"2024-09-14T07:14:03.927575+0000","last_clean":"2024-09-14T07:14:03.927575+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:03.927575+0000","last_undegraded":"2024-09-14T07:14:03.927575+0000","last_fullsized":"2024-09-14T07:14:03.927575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.156989+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"122'743","reported_seq":6372,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936167+0000","last_change":"2024-09-14T07:13:42.661969+0000","last_active":"2024-09-14T07:14:03.936167+0000","last_peered":"2024-09-14T07:14:03.936167+0000","last_clean":"2024-09-14T07:14:03.936167+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:03.936167+0000","last_undegraded":"2024-09-14T07:14:03.936167+0000","last_fullsized":"2024-09-14T07:14:03.936167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:22.151457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"122'710","reported_seq":7301,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937211+0000","last_change":"2024-09-14T07:14:02.916642+0000","last_active":"2024-09-14T07:14:03.937211+0000","last_peered":"2024-09-14T07:14:03.937211+0000","last_clean":"2024-09-14T07:14:03.937211+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:03.937211+0000","last_undegraded":"2024-09-14T07:14:03.937211+0000","last_fullsized":"2024-09-14T07:14:03.937211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:54.210311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"122'225","reported_seq":2726,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937177+0000","last_change":"2024-09-14T07:14:02.921195+0000","last_active":"2024-09-14T07:14:03.937177+0000","last_peered":"2024-09-14T07:14:03.937177+0000","last_clean":"2024-09-14T07:14:03.937177+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:03.937177+0000","last_undegraded":"2024-09-14T07:14:03.937177+0000","last_fullsized":"2024-09-14T07:14:03.937177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.165181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"121'589","reported_seq":5161,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937251+0000","last_change":"2024-09-14T07:14:02.920852+0000","last_active":"2024-09-14T07:14:03.937251+0000","last_peered":"2024-09-14T07:14:03.937251+0000","last_clean":"2024-09-14T07:14:03.937251+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:03.937251+0000","last_undegraded":"2024-09-14T07:14:03.937251+0000","last_fullsized":"2024-09-14T07:14:03.937251+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:44.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"122'650","reported_seq":3189,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.925997+0000","last_change":"2024-09-14T07:13:42.663354+0000","last_active":"2024-09-14T07:14:03.925997+0000","last_peered":"2024-09-14T07:14:03.925997+0000","last_clean":"2024-09-14T07:14:03.925997+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:03.925997+0000","last_undegraded":"2024-09-14T07:14:03.925997+0000","last_fullsized":"2024-09-14T07:14:03.925997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:29.083060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"120'306","reported_seq":3297,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937057+0000","last_change":"2024-09-14T07:14:02.920969+0000","last_active":"2024-09-14T07:14:03.937057+0000","last_peered":"2024-09-14T07:14:03.937057+0000","last_clean":"2024-09-14T07:14:03.937057+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:03.937057+0000","last_undegraded":"2024-09-14T07:14:03.937057+0000","last_fullsized":"2024-09-14T07:14:03.937057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:08.051281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"122'439","reported_seq":5132,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937086+0000","last_change":"2024-09-14T07:14:02.921046+0000","last_active":"2024-09-14T07:14:03.937086+0000","last_peered":"2024-09-14T07:14:03.937086+0000","last_clean":"2024-09-14T07:14:03.937086+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:03.937086+0000","last_undegraded":"2024-09-14T07:14:03.937086+0000","last_fullsized":"2024-09-14T07:14:03.937086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.635423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"122'403","reported_seq":3628,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937071+0000","last_change":"2024-09-14T07:14:02.920858+0000","last_active":"2024-09-14T07:14:03.937071+0000","last_peered":"2024-09-14T07:14:03.937071+0000","last_clean":"2024-09-14T07:14:03.937071+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:03.937071+0000","last_undegraded":"2024-09-14T07:14:03.937071+0000","last_fullsized":"2024-09-14T07:14:03.937071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:00.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15892,"ondisk_log_size":15892,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318286,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28696,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343144,"statfs":{"total":96636764160,"available":96607379456,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55640,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316200,"statfs":{"total":96636764160,"available":96579788800,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:07.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:07.773 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:07.785 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-14T07:14:06.368089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15967,"ondisk_log_size":15967,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358400,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616320,"statfs":{"total":773094113280,"available":772727111680,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-525,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460020"},"pg_stats":[{"pgid":"3.1f","version":"122'603","reported_seq":4720,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936178+0000","last_change":"2024-09-14T07:13:42.659658+0000","last_active":"2024-09-14T07:14:03.936178+0000","last_peered":"2024-09-14T07:14:03.936178+0000","last_clean":"2024-09-14T07:14:03.936178+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:03.936178+0000","last_undegraded":"2024-09-14T07:14:03.936178+0000","last_fullsized":"2024-09-14T07:14:03.936178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:41.983378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"122'300","reported_seq":4448,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927639+0000","last_change":"2024-09-14T07:13:56.875330+0000","last_active":"2024-09-14T07:14:03.927639+0000","last_peered":"2024-09-14T07:14:03.927639+0000","last_clean":"2024-09-14T07:14:03.927639+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:03.927639+0000","last_undegraded":"2024-09-14T07:14:03.927639+0000","last_fullsized":"2024-09-14T07:14:03.927639+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:14.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"121'240","reported_seq":2227,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936220+0000","last_change":"2024-09-14T07:13:42.662042+0000","last_active":"2024-09-14T07:14:03.936220+0000","last_peered":"2024-09-14T07:14:03.936220+0000","last_clean":"2024-09-14T07:14:03.936220+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:03.936220+0000","last_undegraded":"2024-09-14T07:14:03.936220+0000","last_fullsized":"2024-09-14T07:14:03.936220+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:26.267442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"122'570","reported_seq":2495,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936103+0000","last_change":"2024-09-14T07:13:42.661448+0000","last_active":"2024-09-14T07:14:03.936103+0000","last_peered":"2024-09-14T07:14:03.936103+0000","last_clean":"2024-09-14T07:14:03.936103+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:03.936103+0000","last_undegraded":"2024-09-14T07:14:03.936103+0000","last_fullsized":"2024-09-14T07:14:03.936103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:05.161859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"119'280","reported_seq":2959,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936038+0000","last_change":"2024-09-14T07:13:42.659334+0000","last_active":"2024-09-14T07:14:03.936038+0000","last_peered":"2024-09-14T07:14:03.936038+0000","last_clean":"2024-09-14T07:14:03.936038+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:03.936038+0000","last_undegraded":"2024-09-14T07:14:03.936038+0000","last_fullsized":"2024-09-14T07:14:03.936038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:47.800369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"122'707","reported_seq":3855,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.654278+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:23.271059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"122'372","reported_seq":5306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928415+0000","last_change":"2024-09-14T07:13:42.655549+0000","last_active":"2024-09-14T07:14:03.928415+0000","last_peered":"2024-09-14T07:14:03.928415+0000","last_clean":"2024-09-14T07:14:03.928415+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:03.928415+0000","last_undegraded":"2024-09-14T07:14:03.928415+0000","last_fullsized":"2024-09-14T07:14:03.928415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:22.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"118'448","reported_seq":2963,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927393+0000","last_change":"2024-09-14T07:13:56.873416+0000","last_active":"2024-09-14T07:14:03.927393+0000","last_peered":"2024-09-14T07:14:03.927393+0000","last_clean":"2024-09-14T07:14:03.927393+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:03.927393+0000","last_undegraded":"2024-09-14T07:14:03.927393+0000","last_fullsized":"2024-09-14T07:14:03.927393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:37.420626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'724","reported_seq":8332,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936104+0000","last_change":"2024-09-14T07:13:42.659869+0000","last_active":"2024-09-14T07:14:03.936104+0000","last_peered":"2024-09-14T07:14:03.936104+0000","last_clean":"2024-09-14T07:14:03.936104+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:03.936104+0000","last_undegraded":"2024-09-14T07:14:03.936104+0000","last_fullsized":"2024-09-14T07:14:03.936104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.346643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'497","reported_seq":2948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936288+0000","last_change":"2024-09-14T07:13:51.661839+0000","last_active":"2024-09-14T07:14:03.936288+0000","last_peered":"2024-09-14T07:14:03.936288+0000","last_clean":"2024-09-14T07:14:03.936288+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:03.936288+0000","last_undegraded":"2024-09-14T07:14:03.936288+0000","last_fullsized":"2024-09-14T07:14:03.936288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:20.440426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"121'375","reported_seq":1646,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937196+0000","last_change":"2024-09-14T07:14:02.918531+0000","last_active":"2024-09-14T07:14:03.937196+0000","last_peered":"2024-09-14T07:14:03.937196+0000","last_clean":"2024-09-14T07:14:03.937196+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:03.937196+0000","last_undegraded":"2024-09-14T07:14:03.937196+0000","last_fullsized":"2024-09-14T07:14:03.937196+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:48.617880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"120'776","reported_seq":4171,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936736+0000","last_change":"2024-09-14T07:13:51.658453+0000","last_active":"2024-09-14T07:14:03.936736+0000","last_peered":"2024-09-14T07:14:03.936736+0000","last_clean":"2024-09-14T07:14:03.936736+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:03.936736+0000","last_undegraded":"2024-09-14T07:14:03.936736+0000","last_fullsized":"2024-09-14T07:14:03.936736+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:02.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926067+0000","last_change":"2024-09-14T07:13:48.816202+0000","last_active":"2024-09-14T07:14:03.926067+0000","last_peered":"2024-09-14T07:14:03.926067+0000","last_clean":"2024-09-14T07:14:03.926067+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:03.926067+0000","last_undegraded":"2024-09-14T07:14:03.926067+0000","last_fullsized":"2024-09-14T07:14:03.926067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:27.820087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'886","reported_seq":4532,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936035+0000","last_change":"2024-09-14T07:13:42.659395+0000","last_active":"2024-09-14T07:14:03.936035+0000","last_peered":"2024-09-14T07:14:03.936035+0000","last_clean":"2024-09-14T07:14:03.936035+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:03.936035+0000","last_undegraded":"2024-09-14T07:14:03.936035+0000","last_fullsized":"2024-09-14T07:14:03.936035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:20.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928557+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:14:03.928557+0000","last_peered":"2024-09-14T07:14:03.928557+0000","last_clean":"2024-09-14T07:14:03.928557+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:03.928557+0000","last_undegraded":"2024-09-14T07:14:03.928557+0000","last_fullsized":"2024-09-14T07:14:03.928557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5208,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927827+0000","last_change":"2024-09-14T07:13:51.660705+0000","last_active":"2024-09-14T07:14:03.927827+0000","last_peered":"2024-09-14T07:14:03.927827+0000","last_clean":"2024-09-14T07:14:03.927827+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:03.927827+0000","last_undegraded":"2024-09-14T07:14:03.927827+0000","last_fullsized":"2024-09-14T07:14:03.927827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:31.879849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937307+0000","last_change":"2024-09-14T07:14:02.917771+0000","last_active":"2024-09-14T07:14:03.937307+0000","last_peered":"2024-09-14T07:14:03.937307+0000","last_clean":"2024-09-14T07:14:03.937307+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:03.937307+0000","last_undegraded":"2024-09-14T07:14:03.937307+0000","last_fullsized":"2024-09-14T07:14:03.937307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:30.994939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'979","reported_seq":5213,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928530+0000","last_change":"2024-09-14T07:13:42.655908+0000","last_active":"2024-09-14T07:14:03.928530+0000","last_peered":"2024-09-14T07:14:03.928530+0000","last_clean":"2024-09-14T07:14:03.928530+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:03.928530+0000","last_undegraded":"2024-09-14T07:14:03.928530+0000","last_fullsized":"2024-09-14T07:14:03.928530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:38.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928589+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:14:03.928589+0000","last_peered":"2024-09-14T07:14:03.928589+0000","last_clean":"2024-09-14T07:14:03.928589+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:03.928589+0000","last_undegraded":"2024-09-14T07:14:03.928589+0000","last_fullsized":"2024-09-14T07:14:03.928589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"122'549","reported_seq":1466,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936224+0000","last_change":"2024-09-14T07:13:42.661444+0000","last_active":"2024-09-14T07:14:03.936224+0000","last_peered":"2024-09-14T07:14:03.936224+0000","last_clean":"2024-09-14T07:14:03.936224+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:03.936224+0000","last_undegraded":"2024-09-14T07:14:03.936224+0000","last_fullsized":"2024-09-14T07:14:03.936224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:05.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'487","reported_seq":2978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936676+0000","last_change":"2024-09-14T07:13:42.655476+0000","last_active":"2024-09-14T07:14:03.936676+0000","last_peered":"2024-09-14T07:14:03.936676+0000","last_clean":"2024-09-14T07:14:03.936676+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:03.936676+0000","last_undegraded":"2024-09-14T07:14:03.936676+0000","last_fullsized":"2024-09-14T07:14:03.936676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.098950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":157,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936078+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:14:03.936078+0000","last_peered":"2024-09-14T07:14:03.936078+0000","last_clean":"2024-09-14T07:14:03.936078+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:03.936078+0000","last_undegraded":"2024-09-14T07:14:03.936078+0000","last_fullsized":"2024-09-14T07:14:03.936078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'303","reported_seq":4458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928377+0000","last_change":"2024-09-14T07:13:42.656092+0000","last_active":"2024-09-14T07:14:03.928377+0000","last_peered":"2024-09-14T07:14:03.928377+0000","last_clean":"2024-09-14T07:14:03.928377+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:03.928377+0000","last_undegraded":"2024-09-14T07:14:03.928377+0000","last_fullsized":"2024-09-14T07:14:03.928377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:21.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936166+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:14:03.936166+0000","last_peered":"2024-09-14T07:14:03.936166+0000","last_clean":"2024-09-14T07:14:03.936166+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:03.936166+0000","last_undegraded":"2024-09-14T07:14:03.936166+0000","last_fullsized":"2024-09-14T07:14:03.936166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3509,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.935839+0000","last_change":"2024-09-14T07:13:42.658428+0000","last_active":"2024-09-14T07:14:03.935839+0000","last_peered":"2024-09-14T07:14:03.935839+0000","last_clean":"2024-09-14T07:14:03.935839+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:03.935839+0000","last_undegraded":"2024-09-14T07:14:03.935839+0000","last_fullsized":"2024-09-14T07:14:03.935839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937047+0000","last_change":"2024-09-14T07:14:02.915265+0000","last_active":"2024-09-14T07:14:03.937047+0000","last_peered":"2024-09-14T07:14:03.937047+0000","last_clean":"2024-09-14T07:14:03.937047+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:03.937047+0000","last_undegraded":"2024-09-14T07:14:03.937047+0000","last_fullsized":"2024-09-14T07:14:03.937047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:21.271822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"121'333","reported_seq":1925,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927505+0000","last_change":"2024-09-14T07:13:56.872552+0000","last_active":"2024-09-14T07:14:03.927505+0000","last_peered":"2024-09-14T07:14:03.927505+0000","last_clean":"2024-09-14T07:14:03.927505+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:03.927505+0000","last_undegraded":"2024-09-14T07:14:03.927505+0000","last_fullsized":"2024-09-14T07:14:03.927505+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:01.375496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936090+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:14:03.936090+0000","last_peered":"2024-09-14T07:14:03.936090+0000","last_clean":"2024-09-14T07:14:03.936090+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:03.936090+0000","last_undegraded":"2024-09-14T07:14:03.936090+0000","last_fullsized":"2024-09-14T07:14:03.936090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":294,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937174+0000","last_change":"2024-09-14T07:14:02.917799+0000","last_active":"2024-09-14T07:14:03.937174+0000","last_peered":"2024-09-14T07:14:03.937174+0000","last_clean":"2024-09-14T07:14:03.937174+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:03.937174+0000","last_undegraded":"2024-09-14T07:14:03.937174+0000","last_fullsized":"2024-09-14T07:14:03.937174+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:01.507093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'475","reported_seq":3452,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927463+0000","last_change":"2024-09-14T07:13:42.717368+0000","last_active":"2024-09-14T07:14:03.927463+0000","last_peered":"2024-09-14T07:14:03.927463+0000","last_clean":"2024-09-14T07:14:03.927463+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:03.927463+0000","last_undegraded":"2024-09-14T07:14:03.927463+0000","last_fullsized":"2024-09-14T07:14:03.927463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:44.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"122'550","reported_seq":4562,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.653572+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:53.560867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"121'416","reported_seq":2315,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926068+0000","last_change":"2024-09-14T07:13:42.663426+0000","last_active":"2024-09-14T07:14:03.926068+0000","last_peered":"2024-09-14T07:14:03.926068+0000","last_clean":"2024-09-14T07:14:03.926068+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:03.926068+0000","last_undegraded":"2024-09-14T07:14:03.926068+0000","last_fullsized":"2024-09-14T07:14:03.926068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:59.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"121'301","reported_seq":2781,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927575+0000","last_change":"2024-09-14T07:13:56.874425+0000","last_active":"2024-09-14T07:14:03.927575+0000","last_peered":"2024-09-14T07:14:03.927575+0000","last_clean":"2024-09-14T07:14:03.927575+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:03.927575+0000","last_undegraded":"2024-09-14T07:14:03.927575+0000","last_fullsized":"2024-09-14T07:14:03.927575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.156989+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"122'743","reported_seq":6372,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936167+0000","last_change":"2024-09-14T07:13:42.661969+0000","last_active":"2024-09-14T07:14:03.936167+0000","last_peered":"2024-09-14T07:14:03.936167+0000","last_clean":"2024-09-14T07:14:03.936167+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:03.936167+0000","last_undegraded":"2024-09-14T07:14:03.936167+0000","last_fullsized":"2024-09-14T07:14:03.936167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:22.151457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"122'710","reported_seq":7301,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937211+0000","last_change":"2024-09-14T07:14:02.916642+0000","last_active":"2024-09-14T07:14:03.937211+0000","last_peered":"2024-09-14T07:14:03.937211+0000","last_clean":"2024-09-14T07:14:03.937211+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:03.937211+0000","last_undegraded":"2024-09-14T07:14:03.937211+0000","last_fullsized":"2024-09-14T07:14:03.937211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:54.210311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"122'225","reported_seq":2726,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937177+0000","last_change":"2024-09-14T07:14:02.921195+0000","last_active":"2024-09-14T07:14:03.937177+0000","last_peered":"2024-09-14T07:14:03.937177+0000","last_clean":"2024-09-14T07:14:03.937177+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:03.937177+0000","last_undegraded":"2024-09-14T07:14:03.937177+0000","last_fullsized":"2024-09-14T07:14:03.937177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.165181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"121'589","reported_seq":5161,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937251+0000","last_change":"2024-09-14T07:14:02.920852+0000","last_active":"2024-09-14T07:14:03.937251+0000","last_peered":"2024-09-14T07:14:03.937251+0000","last_clean":"2024-09-14T07:14:03.937251+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:03.937251+0000","last_undegraded":"2024-09-14T07:14:03.937251+0000","last_fullsized":"2024-09-14T07:14:03.937251+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:44.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"122'650","reported_seq":3189,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.925997+0000","last_change":"2024-09-14T07:13:42.663354+0000","last_active":"2024-09-14T07:14:03.925997+0000","last_peered":"2024-09-14T07:14:03.925997+0000","last_clean":"2024-09-14T07:14:03.925997+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:03.925997+0000","last_undegraded":"2024-09-14T07:14:03.925997+0000","last_fullsized":"2024-09-14T07:14:03.925997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:29.083060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"120'306","reported_seq":3297,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937057+0000","last_change":"2024-09-14T07:14:02.920969+0000","last_active":"2024-09-14T07:14:03.937057+0000","last_peered":"2024-09-14T07:14:03.937057+0000","last_clean":"2024-09-14T07:14:03.937057+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:03.937057+0000","last_undegraded":"2024-09-14T07:14:03.937057+0000","last_fullsized":"2024-09-14T07:14:03.937057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:08.051281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"122'439","reported_seq":5132,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937086+0000","last_change":"2024-09-14T07:14:02.921046+0000","last_active":"2024-09-14T07:14:03.937086+0000","last_peered":"2024-09-14T07:14:03.937086+0000","last_clean":"2024-09-14T07:14:03.937086+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:03.937086+0000","last_undegraded":"2024-09-14T07:14:03.937086+0000","last_fullsized":"2024-09-14T07:14:03.937086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.635423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"122'403","reported_seq":3628,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937071+0000","last_change":"2024-09-14T07:14:02.920858+0000","last_active":"2024-09-14T07:14:03.937071+0000","last_peered":"2024-09-14T07:14:03.937071+0000","last_clean":"2024-09-14T07:14:03.937071+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:03.937071+0000","last_undegraded":"2024-09-14T07:14:03.937071+0000","last_fullsized":"2024-09-14T07:14:03.937071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:00.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15892,"ondisk_log_size":15892,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318286,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28696,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343144,"statfs":{"total":96636764160,"available":96607379456,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55640,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316200,"statfs":{"total":96636764160,"available":96579788800,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:07.787 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T07:14:07.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-14T07:14:08.090 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T07:14:08.102 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T07:14:08.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:08.389 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-14T07:14:08.368657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15967,"ondisk_log_size":15967,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358400,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616320,"statfs":{"total":773094113280,"available":772727111680,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-525,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.458996"},"pg_stats":[{"pgid":"3.1f","version":"122'603","reported_seq":4720,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936178+0000","last_change":"2024-09-14T07:13:42.659658+0000","last_active":"2024-09-14T07:14:03.936178+0000","last_peered":"2024-09-14T07:14:03.936178+0000","last_clean":"2024-09-14T07:14:03.936178+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:03.936178+0000","last_undegraded":"2024-09-14T07:14:03.936178+0000","last_fullsized":"2024-09-14T07:14:03.936178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:41.983378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"122'300","reported_seq":4448,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927639+0000","last_change":"2024-09-14T07:13:56.875330+0000","last_active":"2024-09-14T07:14:03.927639+0000","last_peered":"2024-09-14T07:14:03.927639+0000","last_clean":"2024-09-14T07:14:03.927639+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:03.927639+0000","last_undegraded":"2024-09-14T07:14:03.927639+0000","last_fullsized":"2024-09-14T07:14:03.927639+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:14.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"121'240","reported_seq":2227,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936220+0000","last_change":"2024-09-14T07:13:42.662042+0000","last_active":"2024-09-14T07:14:03.936220+0000","last_peered":"2024-09-14T07:14:03.936220+0000","last_clean":"2024-09-14T07:14:03.936220+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:03.936220+0000","last_undegraded":"2024-09-14T07:14:03.936220+0000","last_fullsized":"2024-09-14T07:14:03.936220+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:26.267442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"122'570","reported_seq":2495,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936103+0000","last_change":"2024-09-14T07:13:42.661448+0000","last_active":"2024-09-14T07:14:03.936103+0000","last_peered":"2024-09-14T07:14:03.936103+0000","last_clean":"2024-09-14T07:14:03.936103+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:03.936103+0000","last_undegraded":"2024-09-14T07:14:03.936103+0000","last_fullsized":"2024-09-14T07:14:03.936103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:05.161859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"119'280","reported_seq":2959,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936038+0000","last_change":"2024-09-14T07:13:42.659334+0000","last_active":"2024-09-14T07:14:03.936038+0000","last_peered":"2024-09-14T07:14:03.936038+0000","last_clean":"2024-09-14T07:14:03.936038+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:03.936038+0000","last_undegraded":"2024-09-14T07:14:03.936038+0000","last_fullsized":"2024-09-14T07:14:03.936038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:47.800369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"122'707","reported_seq":3855,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.654278+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:23.271059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"122'372","reported_seq":5306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928415+0000","last_change":"2024-09-14T07:13:42.655549+0000","last_active":"2024-09-14T07:14:03.928415+0000","last_peered":"2024-09-14T07:14:03.928415+0000","last_clean":"2024-09-14T07:14:03.928415+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:03.928415+0000","last_undegraded":"2024-09-14T07:14:03.928415+0000","last_fullsized":"2024-09-14T07:14:03.928415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:22.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"118'448","reported_seq":2963,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927393+0000","last_change":"2024-09-14T07:13:56.873416+0000","last_active":"2024-09-14T07:14:03.927393+0000","last_peered":"2024-09-14T07:14:03.927393+0000","last_clean":"2024-09-14T07:14:03.927393+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:03.927393+0000","last_undegraded":"2024-09-14T07:14:03.927393+0000","last_fullsized":"2024-09-14T07:14:03.927393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:37.420626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'724","reported_seq":8332,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936104+0000","last_change":"2024-09-14T07:13:42.659869+0000","last_active":"2024-09-14T07:14:03.936104+0000","last_peered":"2024-09-14T07:14:03.936104+0000","last_clean":"2024-09-14T07:14:03.936104+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:03.936104+0000","last_undegraded":"2024-09-14T07:14:03.936104+0000","last_fullsized":"2024-09-14T07:14:03.936104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.346643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'497","reported_seq":2948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936288+0000","last_change":"2024-09-14T07:13:51.661839+0000","last_active":"2024-09-14T07:14:03.936288+0000","last_peered":"2024-09-14T07:14:03.936288+0000","last_clean":"2024-09-14T07:14:03.936288+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:03.936288+0000","last_undegraded":"2024-09-14T07:14:03.936288+0000","last_fullsized":"2024-09-14T07:14:03.936288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:20.440426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"121'375","reported_seq":1646,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937196+0000","last_change":"2024-09-14T07:14:02.918531+0000","last_active":"2024-09-14T07:14:03.937196+0000","last_peered":"2024-09-14T07:14:03.937196+0000","last_clean":"2024-09-14T07:14:03.937196+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:03.937196+0000","last_undegraded":"2024-09-14T07:14:03.937196+0000","last_fullsized":"2024-09-14T07:14:03.937196+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:48.617880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"120'776","reported_seq":4171,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936736+0000","last_change":"2024-09-14T07:13:51.658453+0000","last_active":"2024-09-14T07:14:03.936736+0000","last_peered":"2024-09-14T07:14:03.936736+0000","last_clean":"2024-09-14T07:14:03.936736+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:03.936736+0000","last_undegraded":"2024-09-14T07:14:03.936736+0000","last_fullsized":"2024-09-14T07:14:03.936736+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:02.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926067+0000","last_change":"2024-09-14T07:13:48.816202+0000","last_active":"2024-09-14T07:14:03.926067+0000","last_peered":"2024-09-14T07:14:03.926067+0000","last_clean":"2024-09-14T07:14:03.926067+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:03.926067+0000","last_undegraded":"2024-09-14T07:14:03.926067+0000","last_fullsized":"2024-09-14T07:14:03.926067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:27.820087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'886","reported_seq":4532,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936035+0000","last_change":"2024-09-14T07:13:42.659395+0000","last_active":"2024-09-14T07:14:03.936035+0000","last_peered":"2024-09-14T07:14:03.936035+0000","last_clean":"2024-09-14T07:14:03.936035+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:03.936035+0000","last_undegraded":"2024-09-14T07:14:03.936035+0000","last_fullsized":"2024-09-14T07:14:03.936035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:20.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928557+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:14:03.928557+0000","last_peered":"2024-09-14T07:14:03.928557+0000","last_clean":"2024-09-14T07:14:03.928557+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:03.928557+0000","last_undegraded":"2024-09-14T07:14:03.928557+0000","last_fullsized":"2024-09-14T07:14:03.928557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5208,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927827+0000","last_change":"2024-09-14T07:13:51.660705+0000","last_active":"2024-09-14T07:14:03.927827+0000","last_peered":"2024-09-14T07:14:03.927827+0000","last_clean":"2024-09-14T07:14:03.927827+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:03.927827+0000","last_undegraded":"2024-09-14T07:14:03.927827+0000","last_fullsized":"2024-09-14T07:14:03.927827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:31.879849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937307+0000","last_change":"2024-09-14T07:14:02.917771+0000","last_active":"2024-09-14T07:14:03.937307+0000","last_peered":"2024-09-14T07:14:03.937307+0000","last_clean":"2024-09-14T07:14:03.937307+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:03.937307+0000","last_undegraded":"2024-09-14T07:14:03.937307+0000","last_fullsized":"2024-09-14T07:14:03.937307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:30.994939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'979","reported_seq":5213,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928530+0000","last_change":"2024-09-14T07:13:42.655908+0000","last_active":"2024-09-14T07:14:03.928530+0000","last_peered":"2024-09-14T07:14:03.928530+0000","last_clean":"2024-09-14T07:14:03.928530+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:03.928530+0000","last_undegraded":"2024-09-14T07:14:03.928530+0000","last_fullsized":"2024-09-14T07:14:03.928530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:38.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928589+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:14:03.928589+0000","last_peered":"2024-09-14T07:14:03.928589+0000","last_clean":"2024-09-14T07:14:03.928589+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:03.928589+0000","last_undegraded":"2024-09-14T07:14:03.928589+0000","last_fullsized":"2024-09-14T07:14:03.928589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"122'549","reported_seq":1466,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936224+0000","last_change":"2024-09-14T07:13:42.661444+0000","last_active":"2024-09-14T07:14:03.936224+0000","last_peered":"2024-09-14T07:14:03.936224+0000","last_clean":"2024-09-14T07:14:03.936224+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:03.936224+0000","last_undegraded":"2024-09-14T07:14:03.936224+0000","last_fullsized":"2024-09-14T07:14:03.936224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:05.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'487","reported_seq":2978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936676+0000","last_change":"2024-09-14T07:13:42.655476+0000","last_active":"2024-09-14T07:14:03.936676+0000","last_peered":"2024-09-14T07:14:03.936676+0000","last_clean":"2024-09-14T07:14:03.936676+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:03.936676+0000","last_undegraded":"2024-09-14T07:14:03.936676+0000","last_fullsized":"2024-09-14T07:14:03.936676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.098950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":157,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936078+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:14:03.936078+0000","last_peered":"2024-09-14T07:14:03.936078+0000","last_clean":"2024-09-14T07:14:03.936078+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:03.936078+0000","last_undegraded":"2024-09-14T07:14:03.936078+0000","last_fullsized":"2024-09-14T07:14:03.936078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'303","reported_seq":4458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928377+0000","last_change":"2024-09-14T07:13:42.656092+0000","last_active":"2024-09-14T07:14:03.928377+0000","last_peered":"2024-09-14T07:14:03.928377+0000","last_clean":"2024-09-14T07:14:03.928377+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:03.928377+0000","last_undegraded":"2024-09-14T07:14:03.928377+0000","last_fullsized":"2024-09-14T07:14:03.928377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:21.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936166+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:14:03.936166+0000","last_peered":"2024-09-14T07:14:03.936166+0000","last_clean":"2024-09-14T07:14:03.936166+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:03.936166+0000","last_undegraded":"2024-09-14T07:14:03.936166+0000","last_fullsized":"2024-09-14T07:14:03.936166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3509,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.935839+0000","last_change":"2024-09-14T07:13:42.658428+0000","last_active":"2024-09-14T07:14:03.935839+0000","last_peered":"2024-09-14T07:14:03.935839+0000","last_clean":"2024-09-14T07:14:03.935839+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:03.935839+0000","last_undegraded":"2024-09-14T07:14:03.935839+0000","last_fullsized":"2024-09-14T07:14:03.935839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937047+0000","last_change":"2024-09-14T07:14:02.915265+0000","last_active":"2024-09-14T07:14:03.937047+0000","last_peered":"2024-09-14T07:14:03.937047+0000","last_clean":"2024-09-14T07:14:03.937047+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:03.937047+0000","last_undegraded":"2024-09-14T07:14:03.937047+0000","last_fullsized":"2024-09-14T07:14:03.937047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:21.271822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"121'333","reported_seq":1925,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927505+0000","last_change":"2024-09-14T07:13:56.872552+0000","last_active":"2024-09-14T07:14:03.927505+0000","last_peered":"2024-09-14T07:14:03.927505+0000","last_clean":"2024-09-14T07:14:03.927505+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:03.927505+0000","last_undegraded":"2024-09-14T07:14:03.927505+0000","last_fullsized":"2024-09-14T07:14:03.927505+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:01.375496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936090+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:14:03.936090+0000","last_peered":"2024-09-14T07:14:03.936090+0000","last_clean":"2024-09-14T07:14:03.936090+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:03.936090+0000","last_undegraded":"2024-09-14T07:14:03.936090+0000","last_fullsized":"2024-09-14T07:14:03.936090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":294,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937174+0000","last_change":"2024-09-14T07:14:02.917799+0000","last_active":"2024-09-14T07:14:03.937174+0000","last_peered":"2024-09-14T07:14:03.937174+0000","last_clean":"2024-09-14T07:14:03.937174+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:03.937174+0000","last_undegraded":"2024-09-14T07:14:03.937174+0000","last_fullsized":"2024-09-14T07:14:03.937174+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:01.507093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'475","reported_seq":3452,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927463+0000","last_change":"2024-09-14T07:13:42.717368+0000","last_active":"2024-09-14T07:14:03.927463+0000","last_peered":"2024-09-14T07:14:03.927463+0000","last_clean":"2024-09-14T07:14:03.927463+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:03.927463+0000","last_undegraded":"2024-09-14T07:14:03.927463+0000","last_fullsized":"2024-09-14T07:14:03.927463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:44.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"122'550","reported_seq":4562,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.653572+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:53.560867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"121'416","reported_seq":2315,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926068+0000","last_change":"2024-09-14T07:13:42.663426+0000","last_active":"2024-09-14T07:14:03.926068+0000","last_peered":"2024-09-14T07:14:03.926068+0000","last_clean":"2024-09-14T07:14:03.926068+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:03.926068+0000","last_undegraded":"2024-09-14T07:14:03.926068+0000","last_fullsized":"2024-09-14T07:14:03.926068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:59.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"121'301","reported_seq":2781,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927575+0000","last_change":"2024-09-14T07:13:56.874425+0000","last_active":"2024-09-14T07:14:03.927575+0000","last_peered":"2024-09-14T07:14:03.927575+0000","last_clean":"2024-09-14T07:14:03.927575+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:03.927575+0000","last_undegraded":"2024-09-14T07:14:03.927575+0000","last_fullsized":"2024-09-14T07:14:03.927575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.156989+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"122'743","reported_seq":6372,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936167+0000","last_change":"2024-09-14T07:13:42.661969+0000","last_active":"2024-09-14T07:14:03.936167+0000","last_peered":"2024-09-14T07:14:03.936167+0000","last_clean":"2024-09-14T07:14:03.936167+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:03.936167+0000","last_undegraded":"2024-09-14T07:14:03.936167+0000","last_fullsized":"2024-09-14T07:14:03.936167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:22.151457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"122'710","reported_seq":7301,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937211+0000","last_change":"2024-09-14T07:14:02.916642+0000","last_active":"2024-09-14T07:14:03.937211+0000","last_peered":"2024-09-14T07:14:03.937211+0000","last_clean":"2024-09-14T07:14:03.937211+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:03.937211+0000","last_undegraded":"2024-09-14T07:14:03.937211+0000","last_fullsized":"2024-09-14T07:14:03.937211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:54.210311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"122'225","reported_seq":2726,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937177+0000","last_change":"2024-09-14T07:14:02.921195+0000","last_active":"2024-09-14T07:14:03.937177+0000","last_peered":"2024-09-14T07:14:03.937177+0000","last_clean":"2024-09-14T07:14:03.937177+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:03.937177+0000","last_undegraded":"2024-09-14T07:14:03.937177+0000","last_fullsized":"2024-09-14T07:14:03.937177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.165181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"121'589","reported_seq":5161,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937251+0000","last_change":"2024-09-14T07:14:02.920852+0000","last_active":"2024-09-14T07:14:03.937251+0000","last_peered":"2024-09-14T07:14:03.937251+0000","last_clean":"2024-09-14T07:14:03.937251+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:03.937251+0000","last_undegraded":"2024-09-14T07:14:03.937251+0000","last_fullsized":"2024-09-14T07:14:03.937251+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:44.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"122'650","reported_seq":3189,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.925997+0000","last_change":"2024-09-14T07:13:42.663354+0000","last_active":"2024-09-14T07:14:03.925997+0000","last_peered":"2024-09-14T07:14:03.925997+0000","last_clean":"2024-09-14T07:14:03.925997+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:03.925997+0000","last_undegraded":"2024-09-14T07:14:03.925997+0000","last_fullsized":"2024-09-14T07:14:03.925997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:29.083060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"120'306","reported_seq":3297,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937057+0000","last_change":"2024-09-14T07:14:02.920969+0000","last_active":"2024-09-14T07:14:03.937057+0000","last_peered":"2024-09-14T07:14:03.937057+0000","last_clean":"2024-09-14T07:14:03.937057+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:03.937057+0000","last_undegraded":"2024-09-14T07:14:03.937057+0000","last_fullsized":"2024-09-14T07:14:03.937057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:08.051281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"122'439","reported_seq":5132,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937086+0000","last_change":"2024-09-14T07:14:02.921046+0000","last_active":"2024-09-14T07:14:03.937086+0000","last_peered":"2024-09-14T07:14:03.937086+0000","last_clean":"2024-09-14T07:14:03.937086+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:03.937086+0000","last_undegraded":"2024-09-14T07:14:03.937086+0000","last_fullsized":"2024-09-14T07:14:03.937086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.635423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"122'403","reported_seq":3628,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937071+0000","last_change":"2024-09-14T07:14:02.920858+0000","last_active":"2024-09-14T07:14:03.937071+0000","last_peered":"2024-09-14T07:14:03.937071+0000","last_clean":"2024-09-14T07:14:03.937071+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:03.937071+0000","last_undegraded":"2024-09-14T07:14:03.937071+0000","last_fullsized":"2024-09-14T07:14:03.937071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:00.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15892,"ondisk_log_size":15892,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318287,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28696,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343144,"statfs":{"total":96636764160,"available":96607379456,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55640,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316200,"statfs":{"total":96636764160,"available":96579788800,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:08.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:08.684 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:08.697 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-14T07:14:08.368657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15967,"ondisk_log_size":15967,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358400,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616320,"statfs":{"total":773094113280,"available":772727111680,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-525,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.458996"},"pg_stats":[{"pgid":"3.1f","version":"122'603","reported_seq":4720,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936178+0000","last_change":"2024-09-14T07:13:42.659658+0000","last_active":"2024-09-14T07:14:03.936178+0000","last_peered":"2024-09-14T07:14:03.936178+0000","last_clean":"2024-09-14T07:14:03.936178+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:03.936178+0000","last_undegraded":"2024-09-14T07:14:03.936178+0000","last_fullsized":"2024-09-14T07:14:03.936178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:41.983378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"122'300","reported_seq":4448,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927639+0000","last_change":"2024-09-14T07:13:56.875330+0000","last_active":"2024-09-14T07:14:03.927639+0000","last_peered":"2024-09-14T07:14:03.927639+0000","last_clean":"2024-09-14T07:14:03.927639+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:03.927639+0000","last_undegraded":"2024-09-14T07:14:03.927639+0000","last_fullsized":"2024-09-14T07:14:03.927639+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:14.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"121'240","reported_seq":2227,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936220+0000","last_change":"2024-09-14T07:13:42.662042+0000","last_active":"2024-09-14T07:14:03.936220+0000","last_peered":"2024-09-14T07:14:03.936220+0000","last_clean":"2024-09-14T07:14:03.936220+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:03.936220+0000","last_undegraded":"2024-09-14T07:14:03.936220+0000","last_fullsized":"2024-09-14T07:14:03.936220+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:26.267442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"122'570","reported_seq":2495,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936103+0000","last_change":"2024-09-14T07:13:42.661448+0000","last_active":"2024-09-14T07:14:03.936103+0000","last_peered":"2024-09-14T07:14:03.936103+0000","last_clean":"2024-09-14T07:14:03.936103+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:03.936103+0000","last_undegraded":"2024-09-14T07:14:03.936103+0000","last_fullsized":"2024-09-14T07:14:03.936103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:05.161859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"119'280","reported_seq":2959,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936038+0000","last_change":"2024-09-14T07:13:42.659334+0000","last_active":"2024-09-14T07:14:03.936038+0000","last_peered":"2024-09-14T07:14:03.936038+0000","last_clean":"2024-09-14T07:14:03.936038+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:03.936038+0000","last_undegraded":"2024-09-14T07:14:03.936038+0000","last_fullsized":"2024-09-14T07:14:03.936038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:47.800369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"122'707","reported_seq":3855,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.654278+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:23.271059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"122'372","reported_seq":5306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928415+0000","last_change":"2024-09-14T07:13:42.655549+0000","last_active":"2024-09-14T07:14:03.928415+0000","last_peered":"2024-09-14T07:14:03.928415+0000","last_clean":"2024-09-14T07:14:03.928415+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:03.928415+0000","last_undegraded":"2024-09-14T07:14:03.928415+0000","last_fullsized":"2024-09-14T07:14:03.928415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:22.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"118'448","reported_seq":2963,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927393+0000","last_change":"2024-09-14T07:13:56.873416+0000","last_active":"2024-09-14T07:14:03.927393+0000","last_peered":"2024-09-14T07:14:03.927393+0000","last_clean":"2024-09-14T07:14:03.927393+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:03.927393+0000","last_undegraded":"2024-09-14T07:14:03.927393+0000","last_fullsized":"2024-09-14T07:14:03.927393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:37.420626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'724","reported_seq":8332,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936104+0000","last_change":"2024-09-14T07:13:42.659869+0000","last_active":"2024-09-14T07:14:03.936104+0000","last_peered":"2024-09-14T07:14:03.936104+0000","last_clean":"2024-09-14T07:14:03.936104+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:03.936104+0000","last_undegraded":"2024-09-14T07:14:03.936104+0000","last_fullsized":"2024-09-14T07:14:03.936104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.346643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'497","reported_seq":2948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936288+0000","last_change":"2024-09-14T07:13:51.661839+0000","last_active":"2024-09-14T07:14:03.936288+0000","last_peered":"2024-09-14T07:14:03.936288+0000","last_clean":"2024-09-14T07:14:03.936288+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:03.936288+0000","last_undegraded":"2024-09-14T07:14:03.936288+0000","last_fullsized":"2024-09-14T07:14:03.936288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:20.440426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"121'375","reported_seq":1646,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937196+0000","last_change":"2024-09-14T07:14:02.918531+0000","last_active":"2024-09-14T07:14:03.937196+0000","last_peered":"2024-09-14T07:14:03.937196+0000","last_clean":"2024-09-14T07:14:03.937196+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:03.937196+0000","last_undegraded":"2024-09-14T07:14:03.937196+0000","last_fullsized":"2024-09-14T07:14:03.937196+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:48.617880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"120'776","reported_seq":4171,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936736+0000","last_change":"2024-09-14T07:13:51.658453+0000","last_active":"2024-09-14T07:14:03.936736+0000","last_peered":"2024-09-14T07:14:03.936736+0000","last_clean":"2024-09-14T07:14:03.936736+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:03.936736+0000","last_undegraded":"2024-09-14T07:14:03.936736+0000","last_fullsized":"2024-09-14T07:14:03.936736+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:02.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926067+0000","last_change":"2024-09-14T07:13:48.816202+0000","last_active":"2024-09-14T07:14:03.926067+0000","last_peered":"2024-09-14T07:14:03.926067+0000","last_clean":"2024-09-14T07:14:03.926067+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:03.926067+0000","last_undegraded":"2024-09-14T07:14:03.926067+0000","last_fullsized":"2024-09-14T07:14:03.926067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:27.820087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'886","reported_seq":4532,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936035+0000","last_change":"2024-09-14T07:13:42.659395+0000","last_active":"2024-09-14T07:14:03.936035+0000","last_peered":"2024-09-14T07:14:03.936035+0000","last_clean":"2024-09-14T07:14:03.936035+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:03.936035+0000","last_undegraded":"2024-09-14T07:14:03.936035+0000","last_fullsized":"2024-09-14T07:14:03.936035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:20.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928557+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:14:03.928557+0000","last_peered":"2024-09-14T07:14:03.928557+0000","last_clean":"2024-09-14T07:14:03.928557+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:03.928557+0000","last_undegraded":"2024-09-14T07:14:03.928557+0000","last_fullsized":"2024-09-14T07:14:03.928557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5208,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927827+0000","last_change":"2024-09-14T07:13:51.660705+0000","last_active":"2024-09-14T07:14:03.927827+0000","last_peered":"2024-09-14T07:14:03.927827+0000","last_clean":"2024-09-14T07:14:03.927827+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:03.927827+0000","last_undegraded":"2024-09-14T07:14:03.927827+0000","last_fullsized":"2024-09-14T07:14:03.927827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:31.879849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937307+0000","last_change":"2024-09-14T07:14:02.917771+0000","last_active":"2024-09-14T07:14:03.937307+0000","last_peered":"2024-09-14T07:14:03.937307+0000","last_clean":"2024-09-14T07:14:03.937307+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:03.937307+0000","last_undegraded":"2024-09-14T07:14:03.937307+0000","last_fullsized":"2024-09-14T07:14:03.937307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:30.994939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'979","reported_seq":5213,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928530+0000","last_change":"2024-09-14T07:13:42.655908+0000","last_active":"2024-09-14T07:14:03.928530+0000","last_peered":"2024-09-14T07:14:03.928530+0000","last_clean":"2024-09-14T07:14:03.928530+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:03.928530+0000","last_undegraded":"2024-09-14T07:14:03.928530+0000","last_fullsized":"2024-09-14T07:14:03.928530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:38.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928589+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:14:03.928589+0000","last_peered":"2024-09-14T07:14:03.928589+0000","last_clean":"2024-09-14T07:14:03.928589+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:03.928589+0000","last_undegraded":"2024-09-14T07:14:03.928589+0000","last_fullsized":"2024-09-14T07:14:03.928589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"122'549","reported_seq":1466,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936224+0000","last_change":"2024-09-14T07:13:42.661444+0000","last_active":"2024-09-14T07:14:03.936224+0000","last_peered":"2024-09-14T07:14:03.936224+0000","last_clean":"2024-09-14T07:14:03.936224+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:03.936224+0000","last_undegraded":"2024-09-14T07:14:03.936224+0000","last_fullsized":"2024-09-14T07:14:03.936224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:05.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'487","reported_seq":2978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936676+0000","last_change":"2024-09-14T07:13:42.655476+0000","last_active":"2024-09-14T07:14:03.936676+0000","last_peered":"2024-09-14T07:14:03.936676+0000","last_clean":"2024-09-14T07:14:03.936676+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:03.936676+0000","last_undegraded":"2024-09-14T07:14:03.936676+0000","last_fullsized":"2024-09-14T07:14:03.936676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.098950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":157,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936078+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:14:03.936078+0000","last_peered":"2024-09-14T07:14:03.936078+0000","last_clean":"2024-09-14T07:14:03.936078+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:03.936078+0000","last_undegraded":"2024-09-14T07:14:03.936078+0000","last_fullsized":"2024-09-14T07:14:03.936078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'303","reported_seq":4458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928377+0000","last_change":"2024-09-14T07:13:42.656092+0000","last_active":"2024-09-14T07:14:03.928377+0000","last_peered":"2024-09-14T07:14:03.928377+0000","last_clean":"2024-09-14T07:14:03.928377+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:03.928377+0000","last_undegraded":"2024-09-14T07:14:03.928377+0000","last_fullsized":"2024-09-14T07:14:03.928377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:21.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936166+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:14:03.936166+0000","last_peered":"2024-09-14T07:14:03.936166+0000","last_clean":"2024-09-14T07:14:03.936166+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:03.936166+0000","last_undegraded":"2024-09-14T07:14:03.936166+0000","last_fullsized":"2024-09-14T07:14:03.936166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3509,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.935839+0000","last_change":"2024-09-14T07:13:42.658428+0000","last_active":"2024-09-14T07:14:03.935839+0000","last_peered":"2024-09-14T07:14:03.935839+0000","last_clean":"2024-09-14T07:14:03.935839+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:03.935839+0000","last_undegraded":"2024-09-14T07:14:03.935839+0000","last_fullsized":"2024-09-14T07:14:03.935839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937047+0000","last_change":"2024-09-14T07:14:02.915265+0000","last_active":"2024-09-14T07:14:03.937047+0000","last_peered":"2024-09-14T07:14:03.937047+0000","last_clean":"2024-09-14T07:14:03.937047+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:03.937047+0000","last_undegraded":"2024-09-14T07:14:03.937047+0000","last_fullsized":"2024-09-14T07:14:03.937047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:21.271822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"121'333","reported_seq":1925,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927505+0000","last_change":"2024-09-14T07:13:56.872552+0000","last_active":"2024-09-14T07:14:03.927505+0000","last_peered":"2024-09-14T07:14:03.927505+0000","last_clean":"2024-09-14T07:14:03.927505+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:03.927505+0000","last_undegraded":"2024-09-14T07:14:03.927505+0000","last_fullsized":"2024-09-14T07:14:03.927505+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:01.375496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936090+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:14:03.936090+0000","last_peered":"2024-09-14T07:14:03.936090+0000","last_clean":"2024-09-14T07:14:03.936090+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:03.936090+0000","last_undegraded":"2024-09-14T07:14:03.936090+0000","last_fullsized":"2024-09-14T07:14:03.936090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":294,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937174+0000","last_change":"2024-09-14T07:14:02.917799+0000","last_active":"2024-09-14T07:14:03.937174+0000","last_peered":"2024-09-14T07:14:03.937174+0000","last_clean":"2024-09-14T07:14:03.937174+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:03.937174+0000","last_undegraded":"2024-09-14T07:14:03.937174+0000","last_fullsized":"2024-09-14T07:14:03.937174+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:01.507093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'475","reported_seq":3452,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927463+0000","last_change":"2024-09-14T07:13:42.717368+0000","last_active":"2024-09-14T07:14:03.927463+0000","last_peered":"2024-09-14T07:14:03.927463+0000","last_clean":"2024-09-14T07:14:03.927463+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:03.927463+0000","last_undegraded":"2024-09-14T07:14:03.927463+0000","last_fullsized":"2024-09-14T07:14:03.927463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:44.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"122'550","reported_seq":4562,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.653572+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:53.560867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"121'416","reported_seq":2315,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926068+0000","last_change":"2024-09-14T07:13:42.663426+0000","last_active":"2024-09-14T07:14:03.926068+0000","last_peered":"2024-09-14T07:14:03.926068+0000","last_clean":"2024-09-14T07:14:03.926068+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:03.926068+0000","last_undegraded":"2024-09-14T07:14:03.926068+0000","last_fullsized":"2024-09-14T07:14:03.926068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:59.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"121'301","reported_seq":2781,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927575+0000","last_change":"2024-09-14T07:13:56.874425+0000","last_active":"2024-09-14T07:14:03.927575+0000","last_peered":"2024-09-14T07:14:03.927575+0000","last_clean":"2024-09-14T07:14:03.927575+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:03.927575+0000","last_undegraded":"2024-09-14T07:14:03.927575+0000","last_fullsized":"2024-09-14T07:14:03.927575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.156989+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"122'743","reported_seq":6372,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936167+0000","last_change":"2024-09-14T07:13:42.661969+0000","last_active":"2024-09-14T07:14:03.936167+0000","last_peered":"2024-09-14T07:14:03.936167+0000","last_clean":"2024-09-14T07:14:03.936167+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:03.936167+0000","last_undegraded":"2024-09-14T07:14:03.936167+0000","last_fullsized":"2024-09-14T07:14:03.936167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:22.151457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"122'710","reported_seq":7301,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937211+0000","last_change":"2024-09-14T07:14:02.916642+0000","last_active":"2024-09-14T07:14:03.937211+0000","last_peered":"2024-09-14T07:14:03.937211+0000","last_clean":"2024-09-14T07:14:03.937211+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:03.937211+0000","last_undegraded":"2024-09-14T07:14:03.937211+0000","last_fullsized":"2024-09-14T07:14:03.937211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:54.210311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"122'225","reported_seq":2726,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937177+0000","last_change":"2024-09-14T07:14:02.921195+0000","last_active":"2024-09-14T07:14:03.937177+0000","last_peered":"2024-09-14T07:14:03.937177+0000","last_clean":"2024-09-14T07:14:03.937177+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:03.937177+0000","last_undegraded":"2024-09-14T07:14:03.937177+0000","last_fullsized":"2024-09-14T07:14:03.937177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.165181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"121'589","reported_seq":5161,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937251+0000","last_change":"2024-09-14T07:14:02.920852+0000","last_active":"2024-09-14T07:14:03.937251+0000","last_peered":"2024-09-14T07:14:03.937251+0000","last_clean":"2024-09-14T07:14:03.937251+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:03.937251+0000","last_undegraded":"2024-09-14T07:14:03.937251+0000","last_fullsized":"2024-09-14T07:14:03.937251+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:44.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"122'650","reported_seq":3189,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.925997+0000","last_change":"2024-09-14T07:13:42.663354+0000","last_active":"2024-09-14T07:14:03.925997+0000","last_peered":"2024-09-14T07:14:03.925997+0000","last_clean":"2024-09-14T07:14:03.925997+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:03.925997+0000","last_undegraded":"2024-09-14T07:14:03.925997+0000","last_fullsized":"2024-09-14T07:14:03.925997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:29.083060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"120'306","reported_seq":3297,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937057+0000","last_change":"2024-09-14T07:14:02.920969+0000","last_active":"2024-09-14T07:14:03.937057+0000","last_peered":"2024-09-14T07:14:03.937057+0000","last_clean":"2024-09-14T07:14:03.937057+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:03.937057+0000","last_undegraded":"2024-09-14T07:14:03.937057+0000","last_fullsized":"2024-09-14T07:14:03.937057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:08.051281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"122'439","reported_seq":5132,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937086+0000","last_change":"2024-09-14T07:14:02.921046+0000","last_active":"2024-09-14T07:14:03.937086+0000","last_peered":"2024-09-14T07:14:03.937086+0000","last_clean":"2024-09-14T07:14:03.937086+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:03.937086+0000","last_undegraded":"2024-09-14T07:14:03.937086+0000","last_fullsized":"2024-09-14T07:14:03.937086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.635423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"122'403","reported_seq":3628,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937071+0000","last_change":"2024-09-14T07:14:02.920858+0000","last_active":"2024-09-14T07:14:03.937071+0000","last_peered":"2024-09-14T07:14:03.937071+0000","last_clean":"2024-09-14T07:14:03.937071+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:03.937071+0000","last_undegraded":"2024-09-14T07:14:03.937071+0000","last_fullsized":"2024-09-14T07:14:03.937071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:00.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15892,"ondisk_log_size":15892,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318287,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28696,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343144,"statfs":{"total":96636764160,"available":96607379456,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55640,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316200,"statfs":{"total":96636764160,"available":96579788800,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:08.699 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T07:14:08.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:08.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:08.985 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:08.997 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-14T07:14:08.368657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15967,"ondisk_log_size":15967,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358400,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616320,"statfs":{"total":773094113280,"available":772727111680,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-525,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.458996"},"pg_stats":[{"pgid":"3.1f","version":"122'603","reported_seq":4720,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936178+0000","last_change":"2024-09-14T07:13:42.659658+0000","last_active":"2024-09-14T07:14:03.936178+0000","last_peered":"2024-09-14T07:14:03.936178+0000","last_clean":"2024-09-14T07:14:03.936178+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:03.936178+0000","last_undegraded":"2024-09-14T07:14:03.936178+0000","last_fullsized":"2024-09-14T07:14:03.936178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:41.983378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"122'300","reported_seq":4448,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927639+0000","last_change":"2024-09-14T07:13:56.875330+0000","last_active":"2024-09-14T07:14:03.927639+0000","last_peered":"2024-09-14T07:14:03.927639+0000","last_clean":"2024-09-14T07:14:03.927639+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:03.927639+0000","last_undegraded":"2024-09-14T07:14:03.927639+0000","last_fullsized":"2024-09-14T07:14:03.927639+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:14.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"121'240","reported_seq":2227,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936220+0000","last_change":"2024-09-14T07:13:42.662042+0000","last_active":"2024-09-14T07:14:03.936220+0000","last_peered":"2024-09-14T07:14:03.936220+0000","last_clean":"2024-09-14T07:14:03.936220+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:03.936220+0000","last_undegraded":"2024-09-14T07:14:03.936220+0000","last_fullsized":"2024-09-14T07:14:03.936220+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:26.267442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"122'570","reported_seq":2495,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936103+0000","last_change":"2024-09-14T07:13:42.661448+0000","last_active":"2024-09-14T07:14:03.936103+0000","last_peered":"2024-09-14T07:14:03.936103+0000","last_clean":"2024-09-14T07:14:03.936103+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:03.936103+0000","last_undegraded":"2024-09-14T07:14:03.936103+0000","last_fullsized":"2024-09-14T07:14:03.936103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:05.161859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"119'280","reported_seq":2959,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936038+0000","last_change":"2024-09-14T07:13:42.659334+0000","last_active":"2024-09-14T07:14:03.936038+0000","last_peered":"2024-09-14T07:14:03.936038+0000","last_clean":"2024-09-14T07:14:03.936038+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:03.936038+0000","last_undegraded":"2024-09-14T07:14:03.936038+0000","last_fullsized":"2024-09-14T07:14:03.936038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:47.800369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"122'707","reported_seq":3855,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.654278+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:23.271059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"122'372","reported_seq":5306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928415+0000","last_change":"2024-09-14T07:13:42.655549+0000","last_active":"2024-09-14T07:14:03.928415+0000","last_peered":"2024-09-14T07:14:03.928415+0000","last_clean":"2024-09-14T07:14:03.928415+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:03.928415+0000","last_undegraded":"2024-09-14T07:14:03.928415+0000","last_fullsized":"2024-09-14T07:14:03.928415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:22.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"118'448","reported_seq":2963,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927393+0000","last_change":"2024-09-14T07:13:56.873416+0000","last_active":"2024-09-14T07:14:03.927393+0000","last_peered":"2024-09-14T07:14:03.927393+0000","last_clean":"2024-09-14T07:14:03.927393+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:03.927393+0000","last_undegraded":"2024-09-14T07:14:03.927393+0000","last_fullsized":"2024-09-14T07:14:03.927393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:37.420626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'724","reported_seq":8332,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936104+0000","last_change":"2024-09-14T07:13:42.659869+0000","last_active":"2024-09-14T07:14:03.936104+0000","last_peered":"2024-09-14T07:14:03.936104+0000","last_clean":"2024-09-14T07:14:03.936104+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:03.936104+0000","last_undegraded":"2024-09-14T07:14:03.936104+0000","last_fullsized":"2024-09-14T07:14:03.936104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.346643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'497","reported_seq":2948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936288+0000","last_change":"2024-09-14T07:13:51.661839+0000","last_active":"2024-09-14T07:14:03.936288+0000","last_peered":"2024-09-14T07:14:03.936288+0000","last_clean":"2024-09-14T07:14:03.936288+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:03.936288+0000","last_undegraded":"2024-09-14T07:14:03.936288+0000","last_fullsized":"2024-09-14T07:14:03.936288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:20.440426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"121'375","reported_seq":1646,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937196+0000","last_change":"2024-09-14T07:14:02.918531+0000","last_active":"2024-09-14T07:14:03.937196+0000","last_peered":"2024-09-14T07:14:03.937196+0000","last_clean":"2024-09-14T07:14:03.937196+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:03.937196+0000","last_undegraded":"2024-09-14T07:14:03.937196+0000","last_fullsized":"2024-09-14T07:14:03.937196+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:48.617880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"120'776","reported_seq":4171,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936736+0000","last_change":"2024-09-14T07:13:51.658453+0000","last_active":"2024-09-14T07:14:03.936736+0000","last_peered":"2024-09-14T07:14:03.936736+0000","last_clean":"2024-09-14T07:14:03.936736+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:03.936736+0000","last_undegraded":"2024-09-14T07:14:03.936736+0000","last_fullsized":"2024-09-14T07:14:03.936736+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:02.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926067+0000","last_change":"2024-09-14T07:13:48.816202+0000","last_active":"2024-09-14T07:14:03.926067+0000","last_peered":"2024-09-14T07:14:03.926067+0000","last_clean":"2024-09-14T07:14:03.926067+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:03.926067+0000","last_undegraded":"2024-09-14T07:14:03.926067+0000","last_fullsized":"2024-09-14T07:14:03.926067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:27.820087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'886","reported_seq":4532,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936035+0000","last_change":"2024-09-14T07:13:42.659395+0000","last_active":"2024-09-14T07:14:03.936035+0000","last_peered":"2024-09-14T07:14:03.936035+0000","last_clean":"2024-09-14T07:14:03.936035+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:03.936035+0000","last_undegraded":"2024-09-14T07:14:03.936035+0000","last_fullsized":"2024-09-14T07:14:03.936035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:20.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928557+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:14:03.928557+0000","last_peered":"2024-09-14T07:14:03.928557+0000","last_clean":"2024-09-14T07:14:03.928557+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:03.928557+0000","last_undegraded":"2024-09-14T07:14:03.928557+0000","last_fullsized":"2024-09-14T07:14:03.928557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5208,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927827+0000","last_change":"2024-09-14T07:13:51.660705+0000","last_active":"2024-09-14T07:14:03.927827+0000","last_peered":"2024-09-14T07:14:03.927827+0000","last_clean":"2024-09-14T07:14:03.927827+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:03.927827+0000","last_undegraded":"2024-09-14T07:14:03.927827+0000","last_fullsized":"2024-09-14T07:14:03.927827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:31.879849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937307+0000","last_change":"2024-09-14T07:14:02.917771+0000","last_active":"2024-09-14T07:14:03.937307+0000","last_peered":"2024-09-14T07:14:03.937307+0000","last_clean":"2024-09-14T07:14:03.937307+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:03.937307+0000","last_undegraded":"2024-09-14T07:14:03.937307+0000","last_fullsized":"2024-09-14T07:14:03.937307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:30.994939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'979","reported_seq":5213,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928530+0000","last_change":"2024-09-14T07:13:42.655908+0000","last_active":"2024-09-14T07:14:03.928530+0000","last_peered":"2024-09-14T07:14:03.928530+0000","last_clean":"2024-09-14T07:14:03.928530+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:03.928530+0000","last_undegraded":"2024-09-14T07:14:03.928530+0000","last_fullsized":"2024-09-14T07:14:03.928530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:38.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928589+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:14:03.928589+0000","last_peered":"2024-09-14T07:14:03.928589+0000","last_clean":"2024-09-14T07:14:03.928589+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:03.928589+0000","last_undegraded":"2024-09-14T07:14:03.928589+0000","last_fullsized":"2024-09-14T07:14:03.928589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"122'549","reported_seq":1466,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936224+0000","last_change":"2024-09-14T07:13:42.661444+0000","last_active":"2024-09-14T07:14:03.936224+0000","last_peered":"2024-09-14T07:14:03.936224+0000","last_clean":"2024-09-14T07:14:03.936224+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:03.936224+0000","last_undegraded":"2024-09-14T07:14:03.936224+0000","last_fullsized":"2024-09-14T07:14:03.936224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:05.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'487","reported_seq":2978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936676+0000","last_change":"2024-09-14T07:13:42.655476+0000","last_active":"2024-09-14T07:14:03.936676+0000","last_peered":"2024-09-14T07:14:03.936676+0000","last_clean":"2024-09-14T07:14:03.936676+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:03.936676+0000","last_undegraded":"2024-09-14T07:14:03.936676+0000","last_fullsized":"2024-09-14T07:14:03.936676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.098950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":157,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936078+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:14:03.936078+0000","last_peered":"2024-09-14T07:14:03.936078+0000","last_clean":"2024-09-14T07:14:03.936078+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:03.936078+0000","last_undegraded":"2024-09-14T07:14:03.936078+0000","last_fullsized":"2024-09-14T07:14:03.936078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'303","reported_seq":4458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928377+0000","last_change":"2024-09-14T07:13:42.656092+0000","last_active":"2024-09-14T07:14:03.928377+0000","last_peered":"2024-09-14T07:14:03.928377+0000","last_clean":"2024-09-14T07:14:03.928377+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:03.928377+0000","last_undegraded":"2024-09-14T07:14:03.928377+0000","last_fullsized":"2024-09-14T07:14:03.928377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:21.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936166+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:14:03.936166+0000","last_peered":"2024-09-14T07:14:03.936166+0000","last_clean":"2024-09-14T07:14:03.936166+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:03.936166+0000","last_undegraded":"2024-09-14T07:14:03.936166+0000","last_fullsized":"2024-09-14T07:14:03.936166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3509,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.935839+0000","last_change":"2024-09-14T07:13:42.658428+0000","last_active":"2024-09-14T07:14:03.935839+0000","last_peered":"2024-09-14T07:14:03.935839+0000","last_clean":"2024-09-14T07:14:03.935839+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:03.935839+0000","last_undegraded":"2024-09-14T07:14:03.935839+0000","last_fullsized":"2024-09-14T07:14:03.935839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937047+0000","last_change":"2024-09-14T07:14:02.915265+0000","last_active":"2024-09-14T07:14:03.937047+0000","last_peered":"2024-09-14T07:14:03.937047+0000","last_clean":"2024-09-14T07:14:03.937047+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:03.937047+0000","last_undegraded":"2024-09-14T07:14:03.937047+0000","last_fullsized":"2024-09-14T07:14:03.937047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:21.271822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"121'333","reported_seq":1925,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927505+0000","last_change":"2024-09-14T07:13:56.872552+0000","last_active":"2024-09-14T07:14:03.927505+0000","last_peered":"2024-09-14T07:14:03.927505+0000","last_clean":"2024-09-14T07:14:03.927505+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:03.927505+0000","last_undegraded":"2024-09-14T07:14:03.927505+0000","last_fullsized":"2024-09-14T07:14:03.927505+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:01.375496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936090+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:14:03.936090+0000","last_peered":"2024-09-14T07:14:03.936090+0000","last_clean":"2024-09-14T07:14:03.936090+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:03.936090+0000","last_undegraded":"2024-09-14T07:14:03.936090+0000","last_fullsized":"2024-09-14T07:14:03.936090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":294,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937174+0000","last_change":"2024-09-14T07:14:02.917799+0000","last_active":"2024-09-14T07:14:03.937174+0000","last_peered":"2024-09-14T07:14:03.937174+0000","last_clean":"2024-09-14T07:14:03.937174+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:03.937174+0000","last_undegraded":"2024-09-14T07:14:03.937174+0000","last_fullsized":"2024-09-14T07:14:03.937174+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:01.507093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'475","reported_seq":3452,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927463+0000","last_change":"2024-09-14T07:13:42.717368+0000","last_active":"2024-09-14T07:14:03.927463+0000","last_peered":"2024-09-14T07:14:03.927463+0000","last_clean":"2024-09-14T07:14:03.927463+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:03.927463+0000","last_undegraded":"2024-09-14T07:14:03.927463+0000","last_fullsized":"2024-09-14T07:14:03.927463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:44.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"122'550","reported_seq":4562,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.653572+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:53.560867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"121'416","reported_seq":2315,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926068+0000","last_change":"2024-09-14T07:13:42.663426+0000","last_active":"2024-09-14T07:14:03.926068+0000","last_peered":"2024-09-14T07:14:03.926068+0000","last_clean":"2024-09-14T07:14:03.926068+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:03.926068+0000","last_undegraded":"2024-09-14T07:14:03.926068+0000","last_fullsized":"2024-09-14T07:14:03.926068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:59.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"121'301","reported_seq":2781,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927575+0000","last_change":"2024-09-14T07:13:56.874425+0000","last_active":"2024-09-14T07:14:03.927575+0000","last_peered":"2024-09-14T07:14:03.927575+0000","last_clean":"2024-09-14T07:14:03.927575+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:03.927575+0000","last_undegraded":"2024-09-14T07:14:03.927575+0000","last_fullsized":"2024-09-14T07:14:03.927575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.156989+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"122'743","reported_seq":6372,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936167+0000","last_change":"2024-09-14T07:13:42.661969+0000","last_active":"2024-09-14T07:14:03.936167+0000","last_peered":"2024-09-14T07:14:03.936167+0000","last_clean":"2024-09-14T07:14:03.936167+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:03.936167+0000","last_undegraded":"2024-09-14T07:14:03.936167+0000","last_fullsized":"2024-09-14T07:14:03.936167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:22.151457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"122'710","reported_seq":7301,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937211+0000","last_change":"2024-09-14T07:14:02.916642+0000","last_active":"2024-09-14T07:14:03.937211+0000","last_peered":"2024-09-14T07:14:03.937211+0000","last_clean":"2024-09-14T07:14:03.937211+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:03.937211+0000","last_undegraded":"2024-09-14T07:14:03.937211+0000","last_fullsized":"2024-09-14T07:14:03.937211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:54.210311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"122'225","reported_seq":2726,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937177+0000","last_change":"2024-09-14T07:14:02.921195+0000","last_active":"2024-09-14T07:14:03.937177+0000","last_peered":"2024-09-14T07:14:03.937177+0000","last_clean":"2024-09-14T07:14:03.937177+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:03.937177+0000","last_undegraded":"2024-09-14T07:14:03.937177+0000","last_fullsized":"2024-09-14T07:14:03.937177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.165181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"121'589","reported_seq":5161,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937251+0000","last_change":"2024-09-14T07:14:02.920852+0000","last_active":"2024-09-14T07:14:03.937251+0000","last_peered":"2024-09-14T07:14:03.937251+0000","last_clean":"2024-09-14T07:14:03.937251+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:03.937251+0000","last_undegraded":"2024-09-14T07:14:03.937251+0000","last_fullsized":"2024-09-14T07:14:03.937251+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:44.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"122'650","reported_seq":3189,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.925997+0000","last_change":"2024-09-14T07:13:42.663354+0000","last_active":"2024-09-14T07:14:03.925997+0000","last_peered":"2024-09-14T07:14:03.925997+0000","last_clean":"2024-09-14T07:14:03.925997+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:03.925997+0000","last_undegraded":"2024-09-14T07:14:03.925997+0000","last_fullsized":"2024-09-14T07:14:03.925997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:29.083060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"120'306","reported_seq":3297,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937057+0000","last_change":"2024-09-14T07:14:02.920969+0000","last_active":"2024-09-14T07:14:03.937057+0000","last_peered":"2024-09-14T07:14:03.937057+0000","last_clean":"2024-09-14T07:14:03.937057+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:03.937057+0000","last_undegraded":"2024-09-14T07:14:03.937057+0000","last_fullsized":"2024-09-14T07:14:03.937057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:08.051281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"122'439","reported_seq":5132,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937086+0000","last_change":"2024-09-14T07:14:02.921046+0000","last_active":"2024-09-14T07:14:03.937086+0000","last_peered":"2024-09-14T07:14:03.937086+0000","last_clean":"2024-09-14T07:14:03.937086+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:03.937086+0000","last_undegraded":"2024-09-14T07:14:03.937086+0000","last_fullsized":"2024-09-14T07:14:03.937086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.635423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"122'403","reported_seq":3628,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937071+0000","last_change":"2024-09-14T07:14:02.920858+0000","last_active":"2024-09-14T07:14:03.937071+0000","last_peered":"2024-09-14T07:14:03.937071+0000","last_clean":"2024-09-14T07:14:03.937071+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:03.937071+0000","last_undegraded":"2024-09-14T07:14:03.937071+0000","last_fullsized":"2024-09-14T07:14:03.937071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:00.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15892,"ondisk_log_size":15892,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318287,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28696,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343144,"statfs":{"total":96636764160,"available":96607379456,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55640,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316200,"statfs":{"total":96636764160,"available":96579788800,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:08.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T07:14:09.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:09.284 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":142,"fsid":"589dc63d-1bfc-48bf-bb57-35804a598e44","created":"2024-09-14T07:11:21.848766+0000","modified":"2024-09-14T07:14:03.920018+0000","last_up_change":"2024-09-14T07:13:02.742048+0000","last_in_change":"2024-09-14T07:13:47.800544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T07:11:36.356620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T07:11:40.724021+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T07:11:50.672481+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":39,"snap_epoch":122,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baa123cb-89ef-45b4-8952-ad69f57110ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889617493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889617493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6829","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6831","nonce":2889617493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6825","nonce":2889617493},{"type":"v1","addr":"172.21.15.71:6827","nonce":2889617493}]},"public_addr":"172.21.15.71:6819/2889617493","cluster_addr":"172.21.15.71:6823/2889617493","heartbeat_back_addr":"172.21.15.71:6831/2889617493","heartbeat_front_addr":"172.21.15.71:6827/2889617493","state":["exists","up"]},{"osd":1,"uuid":"d521eb0c-ea3e-46c6-8e5c-262df62043ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6803","nonce":3955072152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6805","nonce":3955072152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6809","nonce":3955072152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3955072152},{"type":"v1","addr":"172.21.15.71:6807","nonce":3955072152}]},"public_addr":"172.21.15.71:6803/3955072152","cluster_addr":"172.21.15.71:6805/3955072152","heartbeat_back_addr":"172.21.15.71:6809/3955072152","heartbeat_front_addr":"172.21.15.71:6807/3955072152","state":["exists","up"]},{"osd":2,"uuid":"089f22b2-6c41-4854-af61-bb916f617ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6822","nonce":3066758971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6826","nonce":3066758971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6833","nonce":3066758971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3066758971},{"type":"v1","addr":"172.21.15.71:6830","nonce":3066758971}]},"public_addr":"172.21.15.71:6822/3066758971","cluster_addr":"172.21.15.71:6826/3066758971","heartbeat_back_addr":"172.21.15.71:6833/3066758971","heartbeat_front_addr":"172.21.15.71:6830/3066758971","state":["exists","up"]},{"osd":3,"uuid":"5a8d365e-a098-4d07-9927-647c4fc0b3da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6811","nonce":1876512586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6813","nonce":1876512586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6817","nonce":1876512586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1876512586},{"type":"v1","addr":"172.21.15.71:6815","nonce":1876512586}]},"public_addr":"172.21.15.71:6811/1876512586","cluster_addr":"172.21.15.71:6813/1876512586","heartbeat_back_addr":"172.21.15.71:6817/1876512586","heartbeat_front_addr":"172.21.15.71:6815/1876512586","state":["exists","up"]},{"osd":4,"uuid":"13920f12-491b-4330-a5a2-fbf6c6f5242f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6817","nonce":1898851107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6819","nonce":1898851107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6823","nonce":1898851107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1898851107},{"type":"v1","addr":"172.21.15.86:6821","nonce":1898851107}]},"public_addr":"172.21.15.86:6817/1898851107","cluster_addr":"172.21.15.86:6819/1898851107","heartbeat_back_addr":"172.21.15.86:6823/1898851107","heartbeat_front_addr":"172.21.15.86:6821/1898851107","state":["exists","up"]},{"osd":5,"uuid":"5c838ac4-0108-4981-bdee-8a6ae76e1f22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":32,"up_from":82,"up_thru":129,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6825","nonce":708849283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6827","nonce":708849283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6831","nonce":708849283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":708849283},{"type":"v1","addr":"172.21.15.86:6829","nonce":708849283}]},"public_addr":"172.21.15.86:6825/708849283","cluster_addr":"172.21.15.86:6827/708849283","heartbeat_back_addr":"172.21.15.86:6831/708849283","heartbeat_front_addr":"172.21.15.86:6829/708849283","state":["exists","up"]},{"osd":6,"uuid":"e9aacee6-d441-4987-addf-617339375ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6809","nonce":1465682528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6811","nonce":1465682528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6815","nonce":1465682528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1465682528},{"type":"v1","addr":"172.21.15.86:6813","nonce":1465682528}]},"public_addr":"172.21.15.86:6809/1465682528","cluster_addr":"172.21.15.86:6811/1465682528","heartbeat_back_addr":"172.21.15.86:6815/1465682528","heartbeat_front_addr":"172.21.15.86:6813/1465682528","state":["exists","up"]},{"osd":7,"uuid":"9e53e2c5-d137-442a-8ee8-9f8757a8e601","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6801","nonce":2849091451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6803","nonce":2849091451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6807","nonce":2849091451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2849091451},{"type":"v1","addr":"172.21.15.86:6805","nonce":2849091451}]},"public_addr":"172.21.15.86:6801/2849091451","cluster_addr":"172.21.15.86:6803/2849091451","heartbeat_back_addr":"172.21.15.86:6807/2849091451","heartbeat_front_addr":"172.21.15.86:6805/2849091451","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.746971+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.202992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:32.026889+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.140575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.188928+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.701967+0000","dead_epoch":33},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.242666+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T07:11:31.149131+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.12","osds":[7,4]}],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T07:14:10.297 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T07:14:10.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:10.433 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:10.433 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:10.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T07:14:10.730 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T07:14:10.743 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T07:14:10.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:10.866 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:10.866 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:10.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T07:14:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T07:14:11.178 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T07:14:11.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:11.300 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:11.301 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:11.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T07:14:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T07:14:11.611 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T07:14:11.611 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:11.733 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:11.733 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:11.733 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:11.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T07:14:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T07:14:12.044 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T07:14:12.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:12.168 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:12.168 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:12.168 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:12.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T07:14:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T07:14:12.477 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T07:14:12.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:12.600 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:12.600 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:12.611 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T07:14:12.898 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T07:14:12.911 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T07:14:12.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:13.033 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:13.034 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:13.034 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:13.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T07:14:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T07:14:13.340 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T07:14:13.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T07:14:13.462 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T07:14:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T07:14:13.463 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T07:14:13.473 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T07:14:13.758 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T07:14:13.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:14.056 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:14.070 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-14T07:14:12.369348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15967,"ondisk_log_size":15967,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358400,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616320,"statfs":{"total":773094113280,"available":772727111680,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-525,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.458869"},"pg_stats":[{"pgid":"3.1f","version":"122'603","reported_seq":4720,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936178+0000","last_change":"2024-09-14T07:13:42.659658+0000","last_active":"2024-09-14T07:14:03.936178+0000","last_peered":"2024-09-14T07:14:03.936178+0000","last_clean":"2024-09-14T07:14:03.936178+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:03.936178+0000","last_undegraded":"2024-09-14T07:14:03.936178+0000","last_fullsized":"2024-09-14T07:14:03.936178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:41.983378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"122'300","reported_seq":4448,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927639+0000","last_change":"2024-09-14T07:13:56.875330+0000","last_active":"2024-09-14T07:14:03.927639+0000","last_peered":"2024-09-14T07:14:03.927639+0000","last_clean":"2024-09-14T07:14:03.927639+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:03.927639+0000","last_undegraded":"2024-09-14T07:14:03.927639+0000","last_fullsized":"2024-09-14T07:14:03.927639+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:14.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"121'240","reported_seq":2227,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936220+0000","last_change":"2024-09-14T07:13:42.662042+0000","last_active":"2024-09-14T07:14:03.936220+0000","last_peered":"2024-09-14T07:14:03.936220+0000","last_clean":"2024-09-14T07:14:03.936220+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:03.936220+0000","last_undegraded":"2024-09-14T07:14:03.936220+0000","last_fullsized":"2024-09-14T07:14:03.936220+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:26.267442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"122'570","reported_seq":2495,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936103+0000","last_change":"2024-09-14T07:13:42.661448+0000","last_active":"2024-09-14T07:14:03.936103+0000","last_peered":"2024-09-14T07:14:03.936103+0000","last_clean":"2024-09-14T07:14:03.936103+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:03.936103+0000","last_undegraded":"2024-09-14T07:14:03.936103+0000","last_fullsized":"2024-09-14T07:14:03.936103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:05.161859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"119'280","reported_seq":2959,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936038+0000","last_change":"2024-09-14T07:13:42.659334+0000","last_active":"2024-09-14T07:14:03.936038+0000","last_peered":"2024-09-14T07:14:03.936038+0000","last_clean":"2024-09-14T07:14:03.936038+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:03.936038+0000","last_undegraded":"2024-09-14T07:14:03.936038+0000","last_fullsized":"2024-09-14T07:14:03.936038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:47.800369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"122'707","reported_seq":3855,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.654278+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:23.271059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"122'372","reported_seq":5306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928415+0000","last_change":"2024-09-14T07:13:42.655549+0000","last_active":"2024-09-14T07:14:03.928415+0000","last_peered":"2024-09-14T07:14:03.928415+0000","last_clean":"2024-09-14T07:14:03.928415+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:03.928415+0000","last_undegraded":"2024-09-14T07:14:03.928415+0000","last_fullsized":"2024-09-14T07:14:03.928415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:22.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"118'448","reported_seq":2963,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927393+0000","last_change":"2024-09-14T07:13:56.873416+0000","last_active":"2024-09-14T07:14:03.927393+0000","last_peered":"2024-09-14T07:14:03.927393+0000","last_clean":"2024-09-14T07:14:03.927393+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:03.927393+0000","last_undegraded":"2024-09-14T07:14:03.927393+0000","last_fullsized":"2024-09-14T07:14:03.927393+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:37.420626+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'724","reported_seq":8332,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936104+0000","last_change":"2024-09-14T07:13:42.659869+0000","last_active":"2024-09-14T07:14:03.936104+0000","last_peered":"2024-09-14T07:14:03.936104+0000","last_clean":"2024-09-14T07:14:03.936104+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:03.936104+0000","last_undegraded":"2024-09-14T07:14:03.936104+0000","last_fullsized":"2024-09-14T07:14:03.936104+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.346643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'497","reported_seq":2948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936288+0000","last_change":"2024-09-14T07:13:51.661839+0000","last_active":"2024-09-14T07:14:03.936288+0000","last_peered":"2024-09-14T07:14:03.936288+0000","last_clean":"2024-09-14T07:14:03.936288+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:03.936288+0000","last_undegraded":"2024-09-14T07:14:03.936288+0000","last_fullsized":"2024-09-14T07:14:03.936288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:20.440426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"121'375","reported_seq":1646,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937196+0000","last_change":"2024-09-14T07:14:02.918531+0000","last_active":"2024-09-14T07:14:03.937196+0000","last_peered":"2024-09-14T07:14:03.937196+0000","last_clean":"2024-09-14T07:14:03.937196+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:03.937196+0000","last_undegraded":"2024-09-14T07:14:03.937196+0000","last_fullsized":"2024-09-14T07:14:03.937196+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:48.617880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"120'776","reported_seq":4171,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936736+0000","last_change":"2024-09-14T07:13:51.658453+0000","last_active":"2024-09-14T07:14:03.936736+0000","last_peered":"2024-09-14T07:14:03.936736+0000","last_clean":"2024-09-14T07:14:03.936736+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:03.936736+0000","last_undegraded":"2024-09-14T07:14:03.936736+0000","last_fullsized":"2024-09-14T07:14:03.936736+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:02.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926067+0000","last_change":"2024-09-14T07:13:48.816202+0000","last_active":"2024-09-14T07:14:03.926067+0000","last_peered":"2024-09-14T07:14:03.926067+0000","last_clean":"2024-09-14T07:14:03.926067+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:03.926067+0000","last_undegraded":"2024-09-14T07:14:03.926067+0000","last_fullsized":"2024-09-14T07:14:03.926067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:27.820087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'886","reported_seq":4532,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936035+0000","last_change":"2024-09-14T07:13:42.659395+0000","last_active":"2024-09-14T07:14:03.936035+0000","last_peered":"2024-09-14T07:14:03.936035+0000","last_clean":"2024-09-14T07:14:03.936035+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:03.936035+0000","last_undegraded":"2024-09-14T07:14:03.936035+0000","last_fullsized":"2024-09-14T07:14:03.936035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:20.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928557+0000","last_change":"2024-09-14T07:11:44.167216+0000","last_active":"2024-09-14T07:14:03.928557+0000","last_peered":"2024-09-14T07:14:03.928557+0000","last_clean":"2024-09-14T07:14:03.928557+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:03.928557+0000","last_undegraded":"2024-09-14T07:14:03.928557+0000","last_fullsized":"2024-09-14T07:14:03.928557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:48.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"109'370","reported_seq":5208,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927827+0000","last_change":"2024-09-14T07:13:51.660705+0000","last_active":"2024-09-14T07:14:03.927827+0000","last_peered":"2024-09-14T07:14:03.927827+0000","last_clean":"2024-09-14T07:14:03.927827+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:03.927827+0000","last_undegraded":"2024-09-14T07:14:03.927827+0000","last_fullsized":"2024-09-14T07:14:03.927827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:31.879849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937307+0000","last_change":"2024-09-14T07:14:02.917771+0000","last_active":"2024-09-14T07:14:03.937307+0000","last_peered":"2024-09-14T07:14:03.937307+0000","last_clean":"2024-09-14T07:14:03.937307+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:03.937307+0000","last_undegraded":"2024-09-14T07:14:03.937307+0000","last_fullsized":"2024-09-14T07:14:03.937307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:30.994939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"122'979","reported_seq":5213,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928530+0000","last_change":"2024-09-14T07:13:42.655908+0000","last_active":"2024-09-14T07:14:03.928530+0000","last_peered":"2024-09-14T07:14:03.928530+0000","last_clean":"2024-09-14T07:14:03.928530+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:03.928530+0000","last_undegraded":"2024-09-14T07:14:03.928530+0000","last_fullsized":"2024-09-14T07:14:03.928530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:38.090378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928589+0000","last_change":"2024-09-14T07:11:44.167316+0000","last_active":"2024-09-14T07:14:03.928589+0000","last_peered":"2024-09-14T07:14:03.928589+0000","last_clean":"2024-09-14T07:14:03.928589+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:03.928589+0000","last_undegraded":"2024-09-14T07:14:03.928589+0000","last_fullsized":"2024-09-14T07:14:03.928589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:58.328489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"122'549","reported_seq":1466,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936224+0000","last_change":"2024-09-14T07:13:42.661444+0000","last_active":"2024-09-14T07:14:03.936224+0000","last_peered":"2024-09-14T07:14:03.936224+0000","last_clean":"2024-09-14T07:14:03.936224+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:03.936224+0000","last_undegraded":"2024-09-14T07:14:03.936224+0000","last_fullsized":"2024-09-14T07:14:03.936224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:05.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"122'487","reported_seq":2978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936676+0000","last_change":"2024-09-14T07:13:42.655476+0000","last_active":"2024-09-14T07:14:03.936676+0000","last_peered":"2024-09-14T07:14:03.936676+0000","last_clean":"2024-09-14T07:14:03.936676+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:03.936676+0000","last_undegraded":"2024-09-14T07:14:03.936676+0000","last_fullsized":"2024-09-14T07:14:03.936676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:41.098950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":157,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936078+0000","last_change":"2024-09-14T07:13:03.752242+0000","last_active":"2024-09-14T07:14:03.936078+0000","last_peered":"2024-09-14T07:14:03.936078+0000","last_clean":"2024-09-14T07:14:03.936078+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:03.936078+0000","last_undegraded":"2024-09-14T07:14:03.936078+0000","last_fullsized":"2024-09-14T07:14:03.936078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:14.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"121'303","reported_seq":4458,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.928377+0000","last_change":"2024-09-14T07:13:42.656092+0000","last_active":"2024-09-14T07:14:03.928377+0000","last_peered":"2024-09-14T07:14:03.928377+0000","last_clean":"2024-09-14T07:14:03.928377+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:03.928377+0000","last_undegraded":"2024-09-14T07:14:03.928377+0000","last_fullsized":"2024-09-14T07:14:03.928377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:21.198314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":257,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936166+0000","last_change":"2024-09-14T07:11:44.166883+0000","last_active":"2024-09-14T07:14:03.936166+0000","last_peered":"2024-09-14T07:14:03.936166+0000","last_clean":"2024-09-14T07:14:03.936166+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:03.936166+0000","last_undegraded":"2024-09-14T07:14:03.936166+0000","last_fullsized":"2024-09-14T07:14:03.936166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:44.309154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3509,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.935839+0000","last_change":"2024-09-14T07:13:42.658428+0000","last_active":"2024-09-14T07:14:03.935839+0000","last_peered":"2024-09-14T07:14:03.935839+0000","last_clean":"2024-09-14T07:14:03.935839+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:03.935839+0000","last_undegraded":"2024-09-14T07:14:03.935839+0000","last_fullsized":"2024-09-14T07:14:03.935839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937047+0000","last_change":"2024-09-14T07:14:02.915265+0000","last_active":"2024-09-14T07:14:03.937047+0000","last_peered":"2024-09-14T07:14:03.937047+0000","last_clean":"2024-09-14T07:14:03.937047+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:03.937047+0000","last_undegraded":"2024-09-14T07:14:03.937047+0000","last_fullsized":"2024-09-14T07:14:03.937047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:21.271822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"121'333","reported_seq":1925,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927505+0000","last_change":"2024-09-14T07:13:56.872552+0000","last_active":"2024-09-14T07:14:03.927505+0000","last_peered":"2024-09-14T07:14:03.927505+0000","last_clean":"2024-09-14T07:14:03.927505+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:03.927505+0000","last_undegraded":"2024-09-14T07:14:03.927505+0000","last_fullsized":"2024-09-14T07:14:03.927505+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:01.375496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936090+0000","last_change":"2024-09-14T07:13:03.753734+0000","last_active":"2024-09-14T07:14:03.936090+0000","last_peered":"2024-09-14T07:14:03.936090+0000","last_clean":"2024-09-14T07:14:03.936090+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:03.936090+0000","last_undegraded":"2024-09-14T07:14:03.936090+0000","last_fullsized":"2024-09-14T07:14:03.936090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:41.141514+0000","last_clean_scrub_stamp":"2024-09-14T07:11:41.141514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.997350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":294,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937174+0000","last_change":"2024-09-14T07:14:02.917799+0000","last_active":"2024-09-14T07:14:03.937174+0000","last_peered":"2024-09-14T07:14:03.937174+0000","last_clean":"2024-09-14T07:14:03.937174+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:03.937174+0000","last_undegraded":"2024-09-14T07:14:03.937174+0000","last_fullsized":"2024-09-14T07:14:03.937174+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:37.119845+0000","last_clean_scrub_stamp":"2024-09-14T07:11:37.119845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:01.507093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"121'475","reported_seq":3452,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927463+0000","last_change":"2024-09-14T07:13:42.717368+0000","last_active":"2024-09-14T07:14:03.927463+0000","last_peered":"2024-09-14T07:14:03.927463+0000","last_clean":"2024-09-14T07:14:03.927463+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:03.927463+0000","last_undegraded":"2024-09-14T07:14:03.927463+0000","last_fullsized":"2024-09-14T07:14:03.927463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:44.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"122'550","reported_seq":4562,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936590+0000","last_change":"2024-09-14T07:13:42.653572+0000","last_active":"2024-09-14T07:14:03.936590+0000","last_peered":"2024-09-14T07:14:03.936590+0000","last_clean":"2024-09-14T07:14:03.936590+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:03.936590+0000","last_undegraded":"2024-09-14T07:14:03.936590+0000","last_fullsized":"2024-09-14T07:14:03.936590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:53.560867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"121'416","reported_seq":2315,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.926068+0000","last_change":"2024-09-14T07:13:42.663426+0000","last_active":"2024-09-14T07:14:03.926068+0000","last_peered":"2024-09-14T07:14:03.926068+0000","last_clean":"2024-09-14T07:14:03.926068+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:03.926068+0000","last_undegraded":"2024-09-14T07:14:03.926068+0000","last_fullsized":"2024-09-14T07:14:03.926068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:59.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"121'301","reported_seq":2782,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.927626+0000","last_change":"2024-09-14T07:13:56.874425+0000","last_active":"2024-09-14T07:14:03.927626+0000","last_peered":"2024-09-14T07:14:03.927626+0000","last_clean":"2024-09-14T07:14:03.927626+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:03.927626+0000","last_undegraded":"2024-09-14T07:14:03.927626+0000","last_fullsized":"2024-09-14T07:14:03.927626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:23.156989+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"122'743","reported_seq":6372,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.936167+0000","last_change":"2024-09-14T07:13:42.661969+0000","last_active":"2024-09-14T07:14:03.936167+0000","last_peered":"2024-09-14T07:14:03.936167+0000","last_clean":"2024-09-14T07:14:03.936167+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:03.936167+0000","last_undegraded":"2024-09-14T07:14:03.936167+0000","last_fullsized":"2024-09-14T07:14:03.936167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:22.151457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"122'710","reported_seq":7301,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937211+0000","last_change":"2024-09-14T07:14:02.916642+0000","last_active":"2024-09-14T07:14:03.937211+0000","last_peered":"2024-09-14T07:14:03.937211+0000","last_clean":"2024-09-14T07:14:03.937211+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:03.937211+0000","last_undegraded":"2024-09-14T07:14:03.937211+0000","last_fullsized":"2024-09-14T07:14:03.937211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:54.210311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"122'225","reported_seq":2726,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937177+0000","last_change":"2024-09-14T07:14:02.921195+0000","last_active":"2024-09-14T07:14:03.937177+0000","last_peered":"2024-09-14T07:14:03.937177+0000","last_clean":"2024-09-14T07:14:03.937177+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:03.937177+0000","last_undegraded":"2024-09-14T07:14:03.937177+0000","last_fullsized":"2024-09-14T07:14:03.937177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.165181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"121'589","reported_seq":5161,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937251+0000","last_change":"2024-09-14T07:14:02.920852+0000","last_active":"2024-09-14T07:14:03.937251+0000","last_peered":"2024-09-14T07:14:03.937251+0000","last_clean":"2024-09-14T07:14:03.937251+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:03.937251+0000","last_undegraded":"2024-09-14T07:14:03.937251+0000","last_fullsized":"2024-09-14T07:14:03.937251+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:44.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"122'650","reported_seq":3189,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.925997+0000","last_change":"2024-09-14T07:13:42.663354+0000","last_active":"2024-09-14T07:14:03.925997+0000","last_peered":"2024-09-14T07:14:03.925997+0000","last_clean":"2024-09-14T07:14:03.925997+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:03.925997+0000","last_undegraded":"2024-09-14T07:14:03.925997+0000","last_fullsized":"2024-09-14T07:14:03.925997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:29.083060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"120'306","reported_seq":3297,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937057+0000","last_change":"2024-09-14T07:14:02.920969+0000","last_active":"2024-09-14T07:14:03.937057+0000","last_peered":"2024-09-14T07:14:03.937057+0000","last_clean":"2024-09-14T07:14:03.937057+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:03.937057+0000","last_undegraded":"2024-09-14T07:14:03.937057+0000","last_fullsized":"2024-09-14T07:14:03.937057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:08.051281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"122'439","reported_seq":5132,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937086+0000","last_change":"2024-09-14T07:14:02.921046+0000","last_active":"2024-09-14T07:14:03.937086+0000","last_peered":"2024-09-14T07:14:03.937086+0000","last_clean":"2024-09-14T07:14:03.937086+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:03.937086+0000","last_undegraded":"2024-09-14T07:14:03.937086+0000","last_fullsized":"2024-09-14T07:14:03.937086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.635423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"122'403","reported_seq":3628,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:03.937071+0000","last_change":"2024-09-14T07:14:02.920858+0000","last_active":"2024-09-14T07:14:03.937071+0000","last_peered":"2024-09-14T07:14:03.937071+0000","last_clean":"2024-09-14T07:14:03.937071+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:03.937071+0000","last_undegraded":"2024-09-14T07:14:03.937071+0000","last_fullsized":"2024-09-14T07:14:03.937071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:11:51.228149+0000","last_clean_scrub_stamp":"2024-09-14T07:11:51.228149+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:00.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15892,"ondisk_log_size":15892,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318288,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28696,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343144,"statfs":{"total":96636764160,"available":96607379456,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46752,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325088,"statfs":{"total":96636764160,"available":96588890112,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55640,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316200,"statfs":{"total":96636764160,"available":96579788800,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.076 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.077 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.078 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T07:11:41.141514+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T07:11:37.119845+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.079 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T07:11:51.228149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=11, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=7, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T07:14:14.080 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T07:14:34.081 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T07:14:34.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T07:14:34.379 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T07:14:34.391 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-14T07:14:34.374303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":88,"num_read":146823,"num_read_kb":757211,"num_write":18216,"num_write_kb":402859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1685,"num_bytes_recovered":77164622,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16063,"ondisk_log_size":16063,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":358328,"kb_used_data":14456,"kb_used_omap":20,"kb_used_meta":343723,"kb_avail":754616392,"statfs":{"total":773094113280,"available":772727185408,"internally_reserved":0,"allocated":14802944,"data_stored":7696124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20748,"internal_metadata":351973108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002712"},"pg_stats":[{"pgid":"3.1f","version":"142'605","reported_seq":4730,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:12.875973+0000","last_change":"2024-09-14T07:14:12.875973+0000","last_active":"2024-09-14T07:14:12.875973+0000","last_peered":"2024-09-14T07:14:12.875973+0000","last_clean":"2024-09-14T07:14:12.875973+0000","last_became_active":"2024-09-14T07:13:06.770271+0000","last_became_peered":"2024-09-14T07:13:06.770271+0000","last_unstale":"2024-09-14T07:14:12.875973+0000","last_undegraded":"2024-09-14T07:14:12.875973+0000","last_fullsized":"2024-09-14T07:14:12.875973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'605","last_scrub_stamp":"2024-09-14T07:14:12.875888+0000","last_deep_scrub":"142'605","last_deep_scrub_stamp":"2024-09-14T07:14:12.875888+0000","last_clean_scrub_stamp":"2024-09-14T07:14:12.875888+0000","objects_scrubbed":2,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:02:21.641854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0015979670000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6080,"num_read_kb":30266,"num_write":707,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":13030471,"num_keys_recovered":13,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"142'303","reported_seq":4459,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:17.535619+0000","last_change":"2024-09-14T07:14:17.535619+0000","last_active":"2024-09-14T07:14:17.535619+0000","last_peered":"2024-09-14T07:14:17.535619+0000","last_clean":"2024-09-14T07:14:17.535619+0000","last_became_active":"2024-09-14T07:13:56.874206+0000","last_became_peered":"2024-09-14T07:13:56.874206+0000","last_unstale":"2024-09-14T07:14:17.535619+0000","last_undegraded":"2024-09-14T07:14:17.535619+0000","last_fullsized":"2024-09-14T07:14:17.535619+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'303","last_scrub_stamp":"2024-09-14T07:14:17.535536+0000","last_deep_scrub":"142'303","last_deep_scrub_stamp":"2024-09-14T07:14:17.535536+0000","last_clean_scrub_stamp":"2024-09-14T07:14:17.535536+0000","objects_scrubbed":3,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:38.463487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00073486999999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3833,"num_read_kb":18608,"num_write":287,"num_write_kb":18355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"142'245","reported_seq":2240,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:19.503916+0000","last_change":"2024-09-14T07:14:19.503916+0000","last_active":"2024-09-14T07:14:19.503916+0000","last_peered":"2024-09-14T07:14:19.503916+0000","last_clean":"2024-09-14T07:14:19.503916+0000","last_became_active":"2024-09-14T07:13:30.727109+0000","last_became_peered":"2024-09-14T07:13:30.727109+0000","last_unstale":"2024-09-14T07:14:19.503916+0000","last_undegraded":"2024-09-14T07:14:19.503916+0000","last_fullsized":"2024-09-14T07:14:19.503916+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'245","last_scrub_stamp":"2024-09-14T07:14:19.503808+0000","last_deep_scrub":"142'245","last_deep_scrub_stamp":"2024-09-14T07:14:19.503808+0000","last_clean_scrub_stamp":"2024-09-14T07:14:19.503808+0000","objects_scrubbed":5,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:37.538609+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.001696337,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1436,"num_read_kb":8957,"num_write":225,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":4390540,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"142'573","reported_seq":2506,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:18.474984+0000","last_change":"2024-09-14T07:14:18.474984+0000","last_active":"2024-09-14T07:14:18.474984+0000","last_peered":"2024-09-14T07:14:18.474984+0000","last_clean":"2024-09-14T07:14:18.474984+0000","last_became_active":"2024-09-14T07:13:06.768695+0000","last_became_peered":"2024-09-14T07:13:06.768695+0000","last_unstale":"2024-09-14T07:14:18.474984+0000","last_undegraded":"2024-09-14T07:14:18.474984+0000","last_fullsized":"2024-09-14T07:14:18.474984+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'573","last_scrub_stamp":"2024-09-14T07:14:18.474880+0000","last_deep_scrub":"142'573","last_deep_scrub_stamp":"2024-09-14T07:14:18.474880+0000","last_clean_scrub_stamp":"2024-09-14T07:14:18.474880+0000","objects_scrubbed":3,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:26.146861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011224290000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":2794,"num_read_kb":13656,"num_write":655,"num_write_kb":7985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6571727,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"142'282","reported_seq":2970,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:11.853118+0000","last_change":"2024-09-14T07:14:11.853036+0000","last_active":"2024-09-14T07:14:11.853118+0000","last_peered":"2024-09-14T07:14:11.853118+0000","last_clean":"2024-09-14T07:14:11.853118+0000","last_became_active":"2024-09-14T07:11:51.643204+0000","last_became_peered":"2024-09-14T07:11:51.643204+0000","last_unstale":"2024-09-14T07:14:11.853118+0000","last_undegraded":"2024-09-14T07:14:11.853118+0000","last_fullsized":"2024-09-14T07:14:11.853118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'282","last_scrub_stamp":"2024-09-14T07:14:11.852927+0000","last_deep_scrub":"142'282","last_deep_scrub_stamp":"2024-09-14T07:14:11.852927+0000","last_clean_scrub_stamp":"2024-09-14T07:14:11.852927+0000","objects_scrubbed":2,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:31.417664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0015156810000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2548,"num_read_kb":18887,"num_write":300,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"142'711","reported_seq":3868,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.740003+0000","last_change":"2024-09-14T07:14:14.739946+0000","last_active":"2024-09-14T07:14:14.740003+0000","last_peered":"2024-09-14T07:14:14.740003+0000","last_clean":"2024-09-14T07:14:14.740003+0000","last_became_active":"2024-09-14T07:11:51.639521+0000","last_became_peered":"2024-09-14T07:11:51.639521+0000","last_unstale":"2024-09-14T07:14:14.740003+0000","last_undegraded":"2024-09-14T07:14:14.740003+0000","last_fullsized":"2024-09-14T07:14:14.740003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'711","last_scrub_stamp":"2024-09-14T07:14:14.739849+0000","last_deep_scrub":"142'711","last_deep_scrub_stamp":"2024-09-14T07:14:14.739849+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.739849+0000","objects_scrubbed":4,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:37.517645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00131258,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":5048,"num_read_kb":28151,"num_write":1027,"num_write_kb":13690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"142'380","reported_seq":5323,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.066315+0000","last_change":"2024-09-14T07:14:14.066265+0000","last_active":"2024-09-14T07:14:14.066315+0000","last_peered":"2024-09-14T07:14:14.066315+0000","last_clean":"2024-09-14T07:14:14.066315+0000","last_became_active":"2024-09-14T07:11:51.640871+0000","last_became_peered":"2024-09-14T07:11:51.640871+0000","last_unstale":"2024-09-14T07:14:14.066315+0000","last_undegraded":"2024-09-14T07:14:14.066315+0000","last_fullsized":"2024-09-14T07:14:14.066315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'380","last_scrub_stamp":"2024-09-14T07:14:14.066178+0000","last_deep_scrub":"142'380","last_deep_scrub_stamp":"2024-09-14T07:14:14.066178+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.066178+0000","objects_scrubbed":8,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:47.210232+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.00065071200000000001,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":5049,"num_read_kb":21159,"num_write":436,"num_write_kb":8868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"142'450","reported_seq":2974,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:16.568642+0000","last_change":"2024-09-14T07:14:16.568579+0000","last_active":"2024-09-14T07:14:16.568642+0000","last_peered":"2024-09-14T07:14:16.568642+0000","last_clean":"2024-09-14T07:14:16.568642+0000","last_became_active":"2024-09-14T07:13:56.872433+0000","last_became_peered":"2024-09-14T07:13:56.872433+0000","last_unstale":"2024-09-14T07:14:16.568642+0000","last_undegraded":"2024-09-14T07:14:16.568642+0000","last_fullsized":"2024-09-14T07:14:16.568642+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'450","last_scrub_stamp":"2024-09-14T07:14:16.568499+0000","last_deep_scrub":"142'450","last_deep_scrub_stamp":"2024-09-14T07:14:16.568499+0000","last_clean_scrub_stamp":"2024-09-14T07:14:16.568499+0000","objects_scrubbed":2,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:17.245612+0000","scrub_duration":2,"objects_trimmed":1,"snaptrim_duration":0.0092382620000000006,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3914,"num_read_kb":33334,"num_write":499,"num_write_kb":15669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"142'727","reported_seq":8344,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.853814+0000","last_change":"2024-09-14T07:14:14.853757+0000","last_active":"2024-09-14T07:14:14.853814+0000","last_peered":"2024-09-14T07:14:14.853814+0000","last_clean":"2024-09-14T07:14:14.853814+0000","last_became_active":"2024-09-14T07:13:06.772068+0000","last_became_peered":"2024-09-14T07:13:06.772068+0000","last_unstale":"2024-09-14T07:14:14.853814+0000","last_undegraded":"2024-09-14T07:14:14.853814+0000","last_fullsized":"2024-09-14T07:14:14.853814+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'727","last_scrub_stamp":"2024-09-14T07:14:14.853680+0000","last_deep_scrub":"142'727","last_deep_scrub_stamp":"2024-09-14T07:14:14.853680+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.853680+0000","objects_scrubbed":3,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:02.313639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001545933,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":10100,"num_read_kb":41010,"num_write":884,"num_write_kb":14515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":10325002,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"142'498","reported_seq":2957,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:16.540947+0000","last_change":"2024-09-14T07:14:16.540947+0000","last_active":"2024-09-14T07:14:16.540947+0000","last_peered":"2024-09-14T07:14:16.540947+0000","last_clean":"2024-09-14T07:14:16.540947+0000","last_became_active":"2024-09-14T07:13:51.659097+0000","last_became_peered":"2024-09-14T07:13:51.659097+0000","last_unstale":"2024-09-14T07:14:16.540947+0000","last_undegraded":"2024-09-14T07:14:16.540947+0000","last_fullsized":"2024-09-14T07:14:16.540947+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'498","last_scrub_stamp":"2024-09-14T07:14:16.540854+0000","last_deep_scrub":"142'498","last_deep_scrub_stamp":"2024-09-14T07:14:16.540854+0000","last_clean_scrub_stamp":"2024-09-14T07:14:16.540854+0000","objects_scrubbed":1,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:09.891071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00075178400000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3418,"num_read_kb":8785,"num_write":618,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4088774,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"142'377","reported_seq":1656,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:23.289390+0000","last_change":"2024-09-14T07:14:23.289390+0000","last_active":"2024-09-14T07:14:23.289390+0000","last_peered":"2024-09-14T07:14:23.289390+0000","last_clean":"2024-09-14T07:14:23.289390+0000","last_became_active":"2024-09-14T07:14:02.917042+0000","last_became_peered":"2024-09-14T07:14:02.917042+0000","last_unstale":"2024-09-14T07:14:23.289390+0000","last_undegraded":"2024-09-14T07:14:23.289390+0000","last_fullsized":"2024-09-14T07:14:23.289390+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'377","last_scrub_stamp":"2024-09-14T07:14:23.289307+0000","last_deep_scrub":"142'377","last_deep_scrub_stamp":"2024-09-14T07:14:23.289307+0000","last_clean_scrub_stamp":"2024-09-14T07:14:23.289307+0000","objects_scrubbed":2,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:38.599144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074239399999999995,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1550,"num_read_kb":15277,"num_write":418,"num_write_kb":9299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4207495,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"142'779","reported_seq":4183,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:13.750560+0000","last_change":"2024-09-14T07:14:13.750487+0000","last_active":"2024-09-14T07:14:13.750560+0000","last_peered":"2024-09-14T07:14:13.750560+0000","last_clean":"2024-09-14T07:14:13.750560+0000","last_became_active":"2024-09-14T07:13:51.657314+0000","last_became_peered":"2024-09-14T07:13:51.657314+0000","last_unstale":"2024-09-14T07:14:13.750560+0000","last_undegraded":"2024-09-14T07:14:13.750560+0000","last_fullsized":"2024-09-14T07:14:13.750560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'779","last_scrub_stamp":"2024-09-14T07:14:13.750383+0000","last_deep_scrub":"142'779","last_deep_scrub_stamp":"2024-09-14T07:14:13.750383+0000","last_clean_scrub_stamp":"2024-09-14T07:14:13.750383+0000","objects_scrubbed":3,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:25.576786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001241914,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5516,"num_read_kb":29573,"num_write":1158,"num_write_kb":9289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":150,"num_bytes_recovered":105410,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:13.713406+0000","last_change":"2024-09-14T07:14:13.713406+0000","last_active":"2024-09-14T07:14:13.713406+0000","last_peered":"2024-09-14T07:14:13.713406+0000","last_clean":"2024-09-14T07:14:13.713406+0000","last_became_active":"2024-09-14T07:13:48.815823+0000","last_became_peered":"2024-09-14T07:13:48.815823+0000","last_unstale":"2024-09-14T07:14:13.713406+0000","last_undegraded":"2024-09-14T07:14:13.713406+0000","last_fullsized":"2024-09-14T07:14:13.713406+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:14:13.713301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:14:13.713301+0000","last_clean_scrub_stamp":"2024-09-14T07:14:13.713301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:38.529523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059336399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"142'889","reported_seq":4543,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:13.875641+0000","last_change":"2024-09-14T07:14:13.875641+0000","last_active":"2024-09-14T07:14:13.875641+0000","last_peered":"2024-09-14T07:14:13.875641+0000","last_clean":"2024-09-14T07:14:13.875641+0000","last_became_active":"2024-09-14T07:11:51.640620+0000","last_became_peered":"2024-09-14T07:11:51.640620+0000","last_unstale":"2024-09-14T07:14:13.875641+0000","last_undegraded":"2024-09-14T07:14:13.875641+0000","last_fullsized":"2024-09-14T07:14:13.875641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'889","last_scrub_stamp":"2024-09-14T07:14:13.875569+0000","last_deep_scrub":"142'889","last_deep_scrub_stamp":"2024-09-14T07:14:13.875569+0000","last_clean_scrub_stamp":"2024-09-14T07:14:13.875569+0000","objects_scrubbed":3,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:12.013556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001542299,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7270,"num_read_kb":29514,"num_write":992,"num_write_kb":10674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":269,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:12.112341+0000","last_change":"2024-09-14T07:14:12.112341+0000","last_active":"2024-09-14T07:14:12.112341+0000","last_peered":"2024-09-14T07:14:12.112341+0000","last_clean":"2024-09-14T07:14:12.112341+0000","last_became_active":"2024-09-14T07:11:42.160603+0000","last_became_peered":"2024-09-14T07:11:42.160603+0000","last_unstale":"2024-09-14T07:14:12.112341+0000","last_undegraded":"2024-09-14T07:14:12.112341+0000","last_fullsized":"2024-09-14T07:14:12.112341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:14:12.112277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:14:12.112277+0000","last_clean_scrub_stamp":"2024-09-14T07:14:12.112277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.880868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071046599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"142'372","reported_seq":5218,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:13.572076+0000","last_change":"2024-09-14T07:14:13.572076+0000","last_active":"2024-09-14T07:14:13.572076+0000","last_peered":"2024-09-14T07:14:13.572076+0000","last_clean":"2024-09-14T07:14:13.572076+0000","last_became_active":"2024-09-14T07:13:51.659651+0000","last_became_peered":"2024-09-14T07:13:51.659651+0000","last_unstale":"2024-09-14T07:14:13.572076+0000","last_undegraded":"2024-09-14T07:14:13.572076+0000","last_fullsized":"2024-09-14T07:14:13.572076+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'372","last_scrub_stamp":"2024-09-14T07:14:13.572003+0000","last_deep_scrub":"142'372","last_deep_scrub_stamp":"2024-09-14T07:14:13.572003+0000","last_clean_scrub_stamp":"2024-09-14T07:14:13.572003+0000","objects_scrubbed":2,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:46.501976+0000","scrub_duration":3,"objects_trimmed":1,"snaptrim_duration":0.010268739000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5688,"num_read_kb":21815,"num_write":330,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":1142206,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:15.407013+0000","last_change":"2024-09-14T07:14:15.407013+0000","last_active":"2024-09-14T07:14:15.407013+0000","last_peered":"2024-09-14T07:14:15.407013+0000","last_clean":"2024-09-14T07:14:15.407013+0000","last_became_active":"2024-09-14T07:14:02.917454+0000","last_became_peered":"2024-09-14T07:14:02.917454+0000","last_unstale":"2024-09-14T07:14:15.407013+0000","last_undegraded":"2024-09-14T07:14:15.407013+0000","last_fullsized":"2024-09-14T07:14:15.407013+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:14:15.406922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:14:15.406922+0000","last_clean_scrub_stamp":"2024-09-14T07:14:15.406922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:08.763291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"142'983","reported_seq":5225,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:15.021335+0000","last_change":"2024-09-14T07:14:15.021335+0000","last_active":"2024-09-14T07:14:15.021335+0000","last_peered":"2024-09-14T07:14:15.021335+0000","last_clean":"2024-09-14T07:14:15.021335+0000","last_became_active":"2024-09-14T07:11:51.638004+0000","last_became_peered":"2024-09-14T07:11:51.638004+0000","last_unstale":"2024-09-14T07:14:15.021335+0000","last_undegraded":"2024-09-14T07:14:15.021335+0000","last_fullsized":"2024-09-14T07:14:15.021335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'983","last_scrub_stamp":"2024-09-14T07:14:15.021224+0000","last_deep_scrub":"142'983","last_deep_scrub_stamp":"2024-09-14T07:14:15.021224+0000","last_clean_scrub_stamp":"2024-09-14T07:14:15.021224+0000","objects_scrubbed":4,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:58.007672+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00051653599999999995,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9051,"num_read_kb":23251,"num_write":1275,"num_write_kb":11188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":269,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:13.069792+0000","last_change":"2024-09-14T07:14:13.069792+0000","last_active":"2024-09-14T07:14:13.069792+0000","last_peered":"2024-09-14T07:14:13.069792+0000","last_clean":"2024-09-14T07:14:13.069792+0000","last_became_active":"2024-09-14T07:11:42.522058+0000","last_became_peered":"2024-09-14T07:11:42.522058+0000","last_unstale":"2024-09-14T07:14:13.069792+0000","last_undegraded":"2024-09-14T07:14:13.069792+0000","last_fullsized":"2024-09-14T07:14:13.069792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:14:13.069711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:14:13.069711+0000","last_clean_scrub_stamp":"2024-09-14T07:14:13.069711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:50:39.441527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073390300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"142'555","reported_seq":1480,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:17.528054+0000","last_change":"2024-09-14T07:14:17.528054+0000","last_active":"2024-09-14T07:14:17.528054+0000","last_peered":"2024-09-14T07:14:17.528054+0000","last_clean":"2024-09-14T07:14:17.528054+0000","last_became_active":"2024-09-14T07:13:06.770562+0000","last_became_peered":"2024-09-14T07:13:06.770562+0000","last_unstale":"2024-09-14T07:14:17.528054+0000","last_undegraded":"2024-09-14T07:14:17.528054+0000","last_fullsized":"2024-09-14T07:14:17.528054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'555","last_scrub_stamp":"2024-09-14T07:14:17.527969+0000","last_deep_scrub":"142'555","last_deep_scrub_stamp":"2024-09-14T07:14:17.527969+0000","last_clean_scrub_stamp":"2024-09-14T07:14:17.527969+0000","objects_scrubbed":6,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:20.911387+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0010237359999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2003,"num_read_kb":11531,"num_write":725,"num_write_kb":14793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":6422266,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"142'489","reported_seq":2988,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:12.784266+0000","last_change":"2024-09-14T07:14:12.784266+0000","last_active":"2024-09-14T07:14:12.784266+0000","last_peered":"2024-09-14T07:14:12.784266+0000","last_clean":"2024-09-14T07:14:12.784266+0000","last_became_active":"2024-09-14T07:11:51.642020+0000","last_became_peered":"2024-09-14T07:11:51.642020+0000","last_unstale":"2024-09-14T07:14:12.784266+0000","last_undegraded":"2024-09-14T07:14:12.784266+0000","last_fullsized":"2024-09-14T07:14:12.784266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'489","last_scrub_stamp":"2024-09-14T07:14:12.784175+0000","last_deep_scrub":"142'489","last_deep_scrub_stamp":"2024-09-14T07:14:12.784175+0000","last_clean_scrub_stamp":"2024-09-14T07:14:12.784175+0000","objects_scrubbed":2,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:03.094078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017762089999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2335,"num_read_kb":22432,"num_write":539,"num_write_kb":19093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"142'3","reported_seq":166,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:13.513417+0000","last_change":"2024-09-14T07:14:13.513417+0000","last_active":"2024-09-14T07:14:13.513417+0000","last_peered":"2024-09-14T07:14:13.513417+0000","last_clean":"2024-09-14T07:14:13.513417+0000","last_became_active":"2024-09-14T07:13:03.751786+0000","last_became_peered":"2024-09-14T07:13:03.751786+0000","last_unstale":"2024-09-14T07:14:13.513417+0000","last_undegraded":"2024-09-14T07:14:13.513417+0000","last_fullsized":"2024-09-14T07:14:13.513417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'3","last_scrub_stamp":"2024-09-14T07:14:13.513292+0000","last_deep_scrub":"142'3","last_deep_scrub_stamp":"2024-09-14T07:14:13.513292+0000","last_clean_scrub_stamp":"2024-09-14T07:14:13.513292+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:36.753118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"142'305","reported_seq":4468,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:16.006459+0000","last_change":"2024-09-14T07:14:16.006459+0000","last_active":"2024-09-14T07:14:16.006459+0000","last_peered":"2024-09-14T07:14:16.006459+0000","last_clean":"2024-09-14T07:14:16.006459+0000","last_became_active":"2024-09-14T07:11:51.640187+0000","last_became_peered":"2024-09-14T07:11:51.640187+0000","last_unstale":"2024-09-14T07:14:16.006459+0000","last_undegraded":"2024-09-14T07:14:16.006459+0000","last_fullsized":"2024-09-14T07:14:16.006459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'305","last_scrub_stamp":"2024-09-14T07:14:16.006375+0000","last_deep_scrub":"142'305","last_deep_scrub_stamp":"2024-09-14T07:14:16.006375+0000","last_clean_scrub_stamp":"2024-09-14T07:14:16.006375+0000","objects_scrubbed":2,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:12.075677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00097918399999999991,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4231,"num_read_kb":27995,"num_write":258,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:12.429600+0000","last_change":"2024-09-14T07:14:12.429600+0000","last_active":"2024-09-14T07:14:12.429600+0000","last_peered":"2024-09-14T07:14:12.429600+0000","last_clean":"2024-09-14T07:14:12.429600+0000","last_became_active":"2024-09-14T07:11:42.300695+0000","last_became_peered":"2024-09-14T07:11:42.300695+0000","last_unstale":"2024-09-14T07:14:12.429600+0000","last_undegraded":"2024-09-14T07:14:12.429600+0000","last_fullsized":"2024-09-14T07:14:12.429600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:14:12.429521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:14:12.429521+0000","last_clean_scrub_stamp":"2024-09-14T07:14:12.429521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:28.319303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060409600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'286","reported_seq":3517,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:10.865922+0000","last_change":"2024-09-14T07:14:10.865922+0000","last_active":"2024-09-14T07:14:10.865922+0000","last_peered":"2024-09-14T07:14:10.865922+0000","last_clean":"2024-09-14T07:14:10.865922+0000","last_became_active":"2024-09-14T07:11:51.642787+0000","last_became_peered":"2024-09-14T07:11:51.642787+0000","last_unstale":"2024-09-14T07:14:10.865922+0000","last_undegraded":"2024-09-14T07:14:10.865922+0000","last_fullsized":"2024-09-14T07:14:10.865922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"121'286","last_scrub_stamp":"2024-09-14T07:14:10.865824+0000","last_deep_scrub":"121'286","last_deep_scrub_stamp":"2024-09-14T07:14:10.865824+0000","last_clean_scrub_stamp":"2024-09-14T07:14:10.865824+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:42.964849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073186300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3291,"num_read_kb":29044,"num_write":291,"num_write_kb":25810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":199,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:16.364453+0000","last_change":"2024-09-14T07:14:16.364453+0000","last_active":"2024-09-14T07:14:16.364453+0000","last_peered":"2024-09-14T07:14:16.364453+0000","last_clean":"2024-09-14T07:14:16.364453+0000","last_became_active":"2024-09-14T07:14:02.914920+0000","last_became_peered":"2024-09-14T07:14:02.914920+0000","last_unstale":"2024-09-14T07:14:16.364453+0000","last_undegraded":"2024-09-14T07:14:16.364453+0000","last_fullsized":"2024-09-14T07:14:16.364453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T07:14:16.364324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T07:14:16.364324+0000","last_clean_scrub_stamp":"2024-09-14T07:14:16.364324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:01.331027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"142'336","reported_seq":1936,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:12.578180+0000","last_change":"2024-09-14T07:14:12.578180+0000","last_active":"2024-09-14T07:14:12.578180+0000","last_peered":"2024-09-14T07:14:12.578180+0000","last_clean":"2024-09-14T07:14:12.578180+0000","last_became_active":"2024-09-14T07:13:56.871550+0000","last_became_peered":"2024-09-14T07:13:56.871550+0000","last_unstale":"2024-09-14T07:14:12.578180+0000","last_undegraded":"2024-09-14T07:14:12.578180+0000","last_fullsized":"2024-09-14T07:14:12.578180+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'336","last_scrub_stamp":"2024-09-14T07:14:12.578115+0000","last_deep_scrub":"142'336","last_deep_scrub_stamp":"2024-09-14T07:14:12.578115+0000","last_clean_scrub_stamp":"2024-09-14T07:14:12.578115+0000","objects_scrubbed":3,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:44.683465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010871679999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1642,"num_read_kb":10885,"num_write":369,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":63,"num_bytes_recovered":3434372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"142'2","reported_seq":165,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:15.540637+0000","last_change":"2024-09-14T07:14:15.540637+0000","last_active":"2024-09-14T07:14:15.540637+0000","last_peered":"2024-09-14T07:14:15.540637+0000","last_clean":"2024-09-14T07:14:15.540637+0000","last_became_active":"2024-09-14T07:13:03.753224+0000","last_became_peered":"2024-09-14T07:13:03.753224+0000","last_unstale":"2024-09-14T07:14:15.540637+0000","last_undegraded":"2024-09-14T07:14:15.540637+0000","last_fullsized":"2024-09-14T07:14:15.540637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'2","last_scrub_stamp":"2024-09-14T07:14:15.540541+0000","last_deep_scrub":"142'2","last_deep_scrub_stamp":"2024-09-14T07:14:15.540541+0000","last_clean_scrub_stamp":"2024-09-14T07:14:15.540541+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:55.256723+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"142'74","reported_seq":304,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.441094+0000","last_change":"2024-09-14T07:14:14.441094+0000","last_active":"2024-09-14T07:14:14.441094+0000","last_peered":"2024-09-14T07:14:14.441094+0000","last_clean":"2024-09-14T07:14:14.441094+0000","last_became_active":"2024-09-14T07:14:02.917410+0000","last_became_peered":"2024-09-14T07:14:02.917410+0000","last_unstale":"2024-09-14T07:14:14.441094+0000","last_undegraded":"2024-09-14T07:14:14.441094+0000","last_fullsized":"2024-09-14T07:14:14.441094+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'74","last_scrub_stamp":"2024-09-14T07:14:14.441004+0000","last_deep_scrub":"142'74","last_deep_scrub_stamp":"2024-09-14T07:14:14.441004+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.441004+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:38.189381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"142'477","reported_seq":3462,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.551327+0000","last_change":"2024-09-14T07:14:14.551327+0000","last_active":"2024-09-14T07:14:14.551327+0000","last_peered":"2024-09-14T07:14:14.551327+0000","last_clean":"2024-09-14T07:14:14.551327+0000","last_became_active":"2024-09-14T07:11:51.646328+0000","last_became_peered":"2024-09-14T07:11:51.646328+0000","last_unstale":"2024-09-14T07:14:14.551327+0000","last_undegraded":"2024-09-14T07:14:14.551327+0000","last_fullsized":"2024-09-14T07:14:14.551327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'477","last_scrub_stamp":"2024-09-14T07:14:14.551232+0000","last_deep_scrub":"142'477","last_deep_scrub_stamp":"2024-09-14T07:14:14.551232+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.551232+0000","objects_scrubbed":2,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.842492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00082408199999999996,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4896,"num_read_kb":18101,"num_write":525,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"142'554","reported_seq":4574,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:15.737159+0000","last_change":"2024-09-14T07:14:15.737159+0000","last_active":"2024-09-14T07:14:15.737159+0000","last_peered":"2024-09-14T07:14:15.737159+0000","last_clean":"2024-09-14T07:14:15.737159+0000","last_became_active":"2024-09-14T07:11:51.639047+0000","last_became_peered":"2024-09-14T07:11:51.639047+0000","last_unstale":"2024-09-14T07:14:15.737159+0000","last_undegraded":"2024-09-14T07:14:15.737159+0000","last_fullsized":"2024-09-14T07:14:15.737159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'554","last_scrub_stamp":"2024-09-14T07:14:15.737076+0000","last_deep_scrub":"142'554","last_deep_scrub_stamp":"2024-09-14T07:14:15.737076+0000","last_clean_scrub_stamp":"2024-09-14T07:14:15.737076+0000","objects_scrubbed":4,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:43.790366+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00062195499999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6625,"num_read_kb":37364,"num_write":505,"num_write_kb":19497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"142'418","reported_seq":2325,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.729979+0000","last_change":"2024-09-14T07:14:14.729979+0000","last_active":"2024-09-14T07:14:14.729979+0000","last_peered":"2024-09-14T07:14:14.729979+0000","last_clean":"2024-09-14T07:14:14.729979+0000","last_became_active":"2024-09-14T07:11:51.646939+0000","last_became_peered":"2024-09-14T07:11:51.646939+0000","last_unstale":"2024-09-14T07:14:14.729979+0000","last_undegraded":"2024-09-14T07:14:14.729979+0000","last_fullsized":"2024-09-14T07:14:14.729979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'418","last_scrub_stamp":"2024-09-14T07:14:14.729848+0000","last_deep_scrub":"142'418","last_deep_scrub_stamp":"2024-09-14T07:14:14.729848+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.729848+0000","objects_scrubbed":2,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:01.681265+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000568018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1972,"num_read_kb":55190,"num_write":445,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"142'303","reported_seq":2792,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:15.594349+0000","last_change":"2024-09-14T07:14:15.594349+0000","last_active":"2024-09-14T07:14:15.594349+0000","last_peered":"2024-09-14T07:14:15.594349+0000","last_clean":"2024-09-14T07:14:15.594349+0000","last_became_active":"2024-09-14T07:13:56.873336+0000","last_became_peered":"2024-09-14T07:13:56.873336+0000","last_unstale":"2024-09-14T07:14:15.594349+0000","last_undegraded":"2024-09-14T07:14:15.594349+0000","last_fullsized":"2024-09-14T07:14:15.594349+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'303","last_scrub_stamp":"2024-09-14T07:14:15.594246+0000","last_deep_scrub":"142'303","last_deep_scrub_stamp":"2024-09-14T07:14:15.594246+0000","last_clean_scrub_stamp":"2024-09-14T07:14:15.594246+0000","objects_scrubbed":2,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:47:35.358251+0000","scrub_duration":2,"objects_trimmed":2,"snaptrim_duration":0.004506347,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2121,"num_read_kb":21711,"num_write":281,"num_write_kb":10204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"142'745","reported_seq":6382,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:14.501486+0000","last_change":"2024-09-14T07:14:14.501486+0000","last_active":"2024-09-14T07:14:14.501486+0000","last_peered":"2024-09-14T07:14:14.501486+0000","last_clean":"2024-09-14T07:14:14.501486+0000","last_became_active":"2024-09-14T07:13:06.770129+0000","last_became_peered":"2024-09-14T07:13:06.770129+0000","last_unstale":"2024-09-14T07:14:14.501486+0000","last_undegraded":"2024-09-14T07:14:14.501486+0000","last_fullsized":"2024-09-14T07:14:14.501486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'745","last_scrub_stamp":"2024-09-14T07:14:14.501381+0000","last_deep_scrub":"142'745","last_deep_scrub_stamp":"2024-09-14T07:14:14.501381+0000","last_clean_scrub_stamp":"2024-09-14T07:14:14.501381+0000","objects_scrubbed":2,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:42.629134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014191340000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8108,"num_read_kb":25482,"num_write":964,"num_write_kb":8569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6340317,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"142'714","reported_seq":7313,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:19.362506+0000","last_change":"2024-09-14T07:14:19.362506+0000","last_active":"2024-09-14T07:14:19.362506+0000","last_peered":"2024-09-14T07:14:19.362506+0000","last_clean":"2024-09-14T07:14:19.362506+0000","last_became_active":"2024-09-14T07:14:02.915082+0000","last_became_peered":"2024-09-14T07:14:02.915082+0000","last_unstale":"2024-09-14T07:14:19.362506+0000","last_undegraded":"2024-09-14T07:14:19.362506+0000","last_fullsized":"2024-09-14T07:14:19.362506+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'714","last_scrub_stamp":"2024-09-14T07:14:19.362397+0000","last_deep_scrub":"142'714","last_deep_scrub_stamp":"2024-09-14T07:14:19.362397+0000","last_clean_scrub_stamp":"2024-09-14T07:14:19.362397+0000","objects_scrubbed":4,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:02.168058+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0017736819999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10269,"num_read_kb":25473,"num_write":694,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":2678929,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"142'228","reported_seq":2737,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:17.327519+0000","last_change":"2024-09-14T07:14:17.327519+0000","last_active":"2024-09-14T07:14:17.327519+0000","last_peered":"2024-09-14T07:14:17.327519+0000","last_clean":"2024-09-14T07:14:17.327519+0000","last_became_active":"2024-09-14T07:14:02.919127+0000","last_became_peered":"2024-09-14T07:14:02.919127+0000","last_unstale":"2024-09-14T07:14:17.327519+0000","last_undegraded":"2024-09-14T07:14:17.327519+0000","last_fullsized":"2024-09-14T07:14:17.327519+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'228","last_scrub_stamp":"2024-09-14T07:14:17.327433+0000","last_deep_scrub":"142'228","last_deep_scrub_stamp":"2024-09-14T07:14:17.327433+0000","last_clean_scrub_stamp":"2024-09-14T07:14:17.327433+0000","objects_scrubbed":3,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:03.197135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001653472,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2511,"num_read_kb":24714,"num_write":188,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":2840784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"142'593","reported_seq":5173,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:20.331388+0000","last_change":"2024-09-14T07:14:20.331388+0000","last_active":"2024-09-14T07:14:20.331388+0000","last_peered":"2024-09-14T07:14:20.331388+0000","last_clean":"2024-09-14T07:14:20.331388+0000","last_became_active":"2024-09-14T07:14:02.918323+0000","last_became_peered":"2024-09-14T07:14:02.918323+0000","last_unstale":"2024-09-14T07:14:20.331388+0000","last_undegraded":"2024-09-14T07:14:20.331388+0000","last_fullsized":"2024-09-14T07:14:20.331388+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'593","last_scrub_stamp":"2024-09-14T07:14:20.331292+0000","last_deep_scrub":"142'593","last_deep_scrub_stamp":"2024-09-14T07:14:20.331292+0000","last_clean_scrub_stamp":"2024-09-14T07:14:20.331292+0000","objects_scrubbed":4,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:11.277140+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0015816929999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5952,"num_read_kb":19203,"num_write":605,"num_write_kb":9808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6678899,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"142'652","reported_seq":3200,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:15.705083+0000","last_change":"2024-09-14T07:14:15.705083+0000","last_active":"2024-09-14T07:14:15.705083+0000","last_peered":"2024-09-14T07:14:15.705083+0000","last_clean":"2024-09-14T07:14:15.705083+0000","last_became_active":"2024-09-14T07:11:51.648593+0000","last_became_peered":"2024-09-14T07:11:51.648593+0000","last_unstale":"2024-09-14T07:14:15.705083+0000","last_undegraded":"2024-09-14T07:14:15.705083+0000","last_fullsized":"2024-09-14T07:14:15.705083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'652","last_scrub_stamp":"2024-09-14T07:14:15.704986+0000","last_deep_scrub":"142'652","last_deep_scrub_stamp":"2024-09-14T07:14:15.704986+0000","last_clean_scrub_stamp":"2024-09-14T07:14:15.704986+0000","objects_scrubbed":2,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:49.507815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00049517699999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4460,"num_read_kb":14950,"num_write":834,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"142'307","reported_seq":3306,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:18.328986+0000","last_change":"2024-09-14T07:14:18.328986+0000","last_active":"2024-09-14T07:14:18.328986+0000","last_peered":"2024-09-14T07:14:18.328986+0000","last_clean":"2024-09-14T07:14:18.328986+0000","last_became_active":"2024-09-14T07:14:02.918313+0000","last_became_peered":"2024-09-14T07:14:02.918313+0000","last_unstale":"2024-09-14T07:14:18.328986+0000","last_undegraded":"2024-09-14T07:14:18.328986+0000","last_fullsized":"2024-09-14T07:14:18.328986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'307","last_scrub_stamp":"2024-09-14T07:14:18.328881+0000","last_deep_scrub":"142'307","last_deep_scrub_stamp":"2024-09-14T07:14:18.328881+0000","last_clean_scrub_stamp":"2024-09-14T07:14:18.328881+0000","objects_scrubbed":1,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:14.431765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00082432800000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2875,"num_read_kb":42676,"num_write":290,"num_write_kb":22702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":1540670,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"142'443","reported_seq":5144,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:21.284710+0000","last_change":"2024-09-14T07:14:21.284710+0000","last_active":"2024-09-14T07:14:21.284710+0000","last_peered":"2024-09-14T07:14:21.284710+0000","last_clean":"2024-09-14T07:14:21.284710+0000","last_became_active":"2024-09-14T07:14:02.918989+0000","last_became_peered":"2024-09-14T07:14:02.918989+0000","last_unstale":"2024-09-14T07:14:21.284710+0000","last_undegraded":"2024-09-14T07:14:21.284710+0000","last_fullsized":"2024-09-14T07:14:21.284710+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'443","last_scrub_stamp":"2024-09-14T07:14:21.284610+0000","last_deep_scrub":"142'443","last_deep_scrub_stamp":"2024-09-14T07:14:21.284610+0000","last_clean_scrub_stamp":"2024-09-14T07:14:21.284610+0000","objects_scrubbed":4,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:15.812726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00070839899999999996,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6776,"num_read_kb":9486,"num_write":387,"num_write_kb":6043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":136,"num_bytes_recovered":2438054,"num_keys_recovered":58,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"142'405","reported_seq":3638,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-14T07:14:22.301334+0000","last_change":"2024-09-14T07:14:22.301334+0000","last_active":"2024-09-14T07:14:22.301334+0000","last_peered":"2024-09-14T07:14:22.301334+0000","last_clean":"2024-09-14T07:14:22.301334+0000","last_became_active":"2024-09-14T07:14:02.918865+0000","last_became_peered":"2024-09-14T07:14:02.918865+0000","last_unstale":"2024-09-14T07:14:22.301334+0000","last_undegraded":"2024-09-14T07:14:22.301334+0000","last_fullsized":"2024-09-14T07:14:22.301334+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'405","last_scrub_stamp":"2024-09-14T07:14:22.301244+0000","last_deep_scrub":"142'405","last_deep_scrub_stamp":"2024-09-14T07:14:22.301244+0000","last_clean_scrub_stamp":"2024-09-14T07:14:22.301244+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:08.977556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0018584579999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3395,"num_read_kb":18676,"num_write":402,"num_write_kb":6996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":338338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":88,"num_read":146757,"num_read_kb":757156,"num_write":18113,"num_write_kb":401229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1683,"num_bytes_recovered":76574254,"num_keys_recovered":326,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},"log_size":15984,"ondisk_log_size":15984,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":82,"seq":352187318292,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38416,"kb_used_data":1664,"kb_used_omap":9,"kb_used_meta":36726,"kb_avail":94333424,"statfs":{"total":96636764160,"available":96597426176,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9592,"internal_metadata":37608072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55056,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316784,"statfs":{"total":96636764160,"available":96580386816,"internally_reserved":0,"allocated":1703936,"data_stored":814433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28684,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343156,"statfs":{"total":96636764160,"available":96607391744,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41164,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330676,"statfs":{"total":96636764160,"available":96594612224,"internally_reserved":0,"allocated":1699840,"data_stored":814414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46740,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325100,"statfs":{"total":96636764160,"available":96588902400,"internally_reserved":0,"allocated":1708032,"data_stored":814452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2293760,"data_stored":1404782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6086,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T07:14:34.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T07:14:34.696 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T07:14:34.696 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T07:14:34.696 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T07:14:34.696 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:34.736 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T07:14:34.736 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T07:14:34.736 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:34.819 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T07:14:34.820 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T07:14:34.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:34.854 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T07:14:34.854 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T07:14:34.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:34.929 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T07:14:34.929 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T07:14:34.929 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:34.969 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T07:14:34.969 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T07:14:34.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.043 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T07:14:35.043 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T07:14:35.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.111 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T07:14:35.112 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T07:14:35.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.186 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T07:14:35.187 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T07:14:35.187 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T07:14:35.187 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.214 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T07:14:35.214 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T07:14:35.214 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.255 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T07:14:35.255 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T07:14:35.255 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T07:14:35.255 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.267 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T07:14:35.267 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T07:14:35.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.318 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T07:14:35.319 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T07:14:35.319 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T07:14:35.331 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T07:14:35.331 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T07:14:35.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-14T07:14:35.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:14:35.392 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T07:14:35.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:14:35.624 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T07:14:35.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:14:35.698 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T07:14:35.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:14:35.755 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T07:14:35.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:14:35.830 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T07:14:35.957 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:14:35.957 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T07:14:36.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:14:36.026 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T07:14:36.083 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:14:36.083 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T07:14:36.126 INFO:tasks.ceph:Archiving mon data... 2024-09-14T07:14:36.127 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/data/mon.a.tgz 2024-09-14T07:14:36.127 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-14T07:14:36.144 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.gYw4gFgq7P 2024-09-14T07:14:36.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gYw4gFgq7P 2024-09-14T07:14:36.296 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.gYw4gFgq7P 2024-09-14T07:14:36.379 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.gYw4gFgq7P is 374KB 2024-09-14T07:14:36.476 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.gYw4gFgq7P 2024-09-14T07:14:36.491 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/data/mon.c.tgz 2024-09-14T07:14:36.491 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-14T07:14:36.545 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.aWuhKPNXRt 2024-09-14T07:14:36.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aWuhKPNXRt 2024-09-14T07:14:36.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.aWuhKPNXRt 2024-09-14T07:14:36.793 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.aWuhKPNXRt is 521KB 2024-09-14T07:14:36.891 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.aWuhKPNXRt 2024-09-14T07:14:36.907 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/data/mon.b.tgz 2024-09-14T07:14:36.907 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-14T07:14:36.925 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.MqBCljYfjw 2024-09-14T07:14:36.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MqBCljYfjw 2024-09-14T07:14:37.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.MqBCljYfjw 2024-09-14T07:14:37.190 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.MqBCljYfjw is 520KB 2024-09-14T07:14:37.289 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.MqBCljYfjw 2024-09-14T07:14:37.304 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T07:14:37.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T07:14:37.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T07:14:37.386 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T07:14:37.423 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T07:14:37.423 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T07:14:37.425 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/remote/smithi071/crash 2024-09-14T07:14:37.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T07:14:37.451 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/remote/smithi086/crash 2024-09-14T07:14:37.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T07:14:37.487 INFO:tasks.ceph:Compressing logs... 2024-09-14T07:14:37.487 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T07:14:37.495 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T07:14:37.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T07:14:37.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39783.log 2024-09-14T07:14:37.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56858.log 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33036.log 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33116.log 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33036.log.gz 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32996.log 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33116.log.gz 2024-09-14T07:14:37.572 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.39838.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32996.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32996.log.gz 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/objectstore_tool.39838.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.40127.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.40422.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/objectstore_tool.40127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/objectstore_tool.40422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33247.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.39838.log.gz 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33247.log.gz 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.40127.log.gz 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.41260.log 2024-09-14T07:14:37.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/objectstore_tool.41260.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33167.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mgr.x.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.40422.log.gz 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- 95.0% -- replaced with /var/log/ceph/objectstore_tool.41260.log.gz 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr: /var/log/ceph/ceph-client.admin.33076.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33076.log.gz 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.33207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-09-14T07:14:37.574 INFO:teuthology.orchestra.run.smithi086.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44849.log 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39783.log.gz 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57194.log 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56858.log.gz 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44849.log.gz 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43297.log 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39110.log 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57194.log.gz 2024-09-14T07:14:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57572.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43297.log.gz 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39979.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39110.log.gz 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56407.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57572.log.gz 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48753.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39979.log.gz 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55734.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56407.log.gz 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54372.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48753.log.gz 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39777.log 2024-09-14T07:14:37.628 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55734.log.gz 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56648.log 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54372.log.gz 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55178.log 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39777.log.gz 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55737.log 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56648.log.gz 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56410.log 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55178.log.gz 2024-09-14T07:14:37.629 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40021.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55737.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33473.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56410.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45444.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40021.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40694.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33473.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56942.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45444.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56774.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40694.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56942.log.gz 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2024-09-14T07:14:37.630 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56774.log.gz 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46434.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55556.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46434.log.gz 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47660.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55556.log.gz 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53279.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47660.log.gz 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-09-14T07:14:37.631 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50258.log 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53279.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55136.log 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50258.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55136.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55136.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50115.log 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54842.log 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50115.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.55731.log -- replaced with /var/log/ceph/ceph-client.admin.50115.log.gz 2024-09-14T07:14:37.632 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41242.log 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54842.log.gz 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55731.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55731.log.gz -5 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41441.log 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51803.log 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41242.log.gz 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57404.log 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41441.log.gz 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51803.log.gz 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57404.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27243.log 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57404.log.gz 2024-09-14T07:14:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52895.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.27243.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27243.log.gz 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55725.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52895.log.gz 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55725.log.gz 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51003.log 2024-09-14T07:14:37.634 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33080.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41720.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51003.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33080.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56289.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41720.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56405.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54711.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56289.log.gz 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53058.log 2024-09-14T07:14:37.635 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56405.log.gz 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54711.log.gz 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44743.log 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54926.log 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53058.log.gz 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49699.log 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44743.log.gz 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54926.log.gz 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49699.log.gz 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43231.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz /var/log/ceph/ceph-client.admin.57026.log 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T07:14:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49570.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39780.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57026.log.gz 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40432.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49570.log.gz 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55738.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39780.log.gz 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40432.log.gz 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55010.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55738.log.gz 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51544.log 2024-09-14T07:14:37.637 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57320.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55010.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38671.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51544.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52794.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57320.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38671.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52794.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.39365.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52794.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39467.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56404.log 2024-09-14T07:14:37.638 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39365.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50725.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39467.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39367.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56404.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50725.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50360.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39367.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39367.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43973.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50360.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40293.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43973.log.gz 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55736.log 2024-09-14T07:14:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53642.log 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40293.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56067.log 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55736.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39307.log 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56606.log 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56067.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39105.log 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39307.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47983.log 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56606.log.gz 2024-09-14T07:14:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55220.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39105.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47983.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56732.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38752.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55220.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56732.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39100.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38752.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41339.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44744.log 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39100.log.gz 2024-09-14T07:14:37.641 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41339.log.gz 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48300.log 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40878.log 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44744.log.gz 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48300.log.gz 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40063.log 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54009.log 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40878.log.gz 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40063.log.gz 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47696.log 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40433.log 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54009.log.gz 2024-09-14T07:14:37.642 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47696.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.47696.log.gz --verbose 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr: -- /var/log/ceph/ceph-client.admin.39464.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57530.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40433.log.gz 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57530.log.gz 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54968.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54968.log.gz 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46255.log 2024-09-14T07:14:37.643 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54287.log 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46255.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46255.log.gz 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40591.log 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55094.log 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54287.log.gz 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40591.log.gz 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44035.log 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54795.log 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55094.log.gz 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44035.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44035.log.gz -- 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.53139.log 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54795.log.gz 2024-09-14T07:14:37.644 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40189.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53139.log.gz 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56984.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40189.log.gz 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53480.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.41897.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39101.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56984.log.gz 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51285.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39101.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39101.log.gz 2024-09-14T07:14:37.645 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51285.log.gz 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39366.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5/var/log/ceph/ceph-mon.c.log: --verbose -- /var/log/ceph/ceph-client.admin.57614.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42985.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39366.log.gz 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52737.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57614.log.gz 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49652.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42985.log.gz 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52737.log.gz 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55728.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49652.log.gz 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2024-09-14T07:14:37.646 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55728.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52340.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56074.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52340.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49349.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55052.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56074.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51601.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49349.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38448.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55052.log.gz 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44890.log 2024-09-14T07:14:37.647 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51601.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55430.log 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38448.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44890.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33382.log 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40347.log 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55430.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39804.log 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33382.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.40347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55346.log 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57654.log 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39804.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.0.40347.log.gz 2024-09-14T07:14:37.648 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39109.log 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55346.log.gz 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47247.log 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57654.log.gz 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39109.log.gz 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56069.log 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47247.log.gz 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51085.log 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-09-14T07:14:37.649 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56069.log.gz 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42453.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51085.log.gz 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54884.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40776.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42453.log.gz 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54753.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54884.log.gz 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40776.log.gz 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55304.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38887.log 2024-09-14T07:14:37.650 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54753.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56816.log 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55304.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38887.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39461.log 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56816.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39461.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41638.log 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42750.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.45918.log 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41638.log.gz 2024-09-14T07:14:37.651 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53865.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57446.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56290.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53865.log.gz 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57446.log: /var/log/ceph/ceph-client.admin.53795.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57446.log.gz 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56409.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56290.log.gz 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56690.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53795.log.gz 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56409.log.gz 2024-09-14T07:14:37.652 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57068.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56690.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54288.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42568.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57068.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54288.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46710.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42568.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46617.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46710.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46710.log.gz 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56071.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55388.log 2024-09-14T07:14:37.653 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56071.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52635.log 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55388.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39111.log 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52635.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47192.log 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39111.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48078.log 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47192.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48375.log 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48078.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48375.log.gz 2024-09-14T07:14:37.654 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56062.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55514.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56062.log.gz 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50420.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55514.log.gz 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50420.log.gz 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46875.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45187.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46875.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49590.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46875.log.gz 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39107.log 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45187.log.gz 2024-09-14T07:14:37.655 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49590.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49590.log.gz 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39107.log.gz 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57236.log 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50621.log 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.57236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57236.log.gz 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57278.log 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50621.log.gz 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57278.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56073.log 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57278.log.gz 2024-09-14T07:14:37.656 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40431.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56073.log.gz 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gz 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53360.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40431.log.gz 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55735.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42251.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-09-14T07:14:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55735.log.gz 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42251.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49145.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49050.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49145.log.gz 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39108.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49050.log.gz 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57362.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39108.log.gz 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46496.log 2024-09-14T07:14:37.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57362.log.gz 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57488.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46496.log.gz 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57488.log.gzgzip 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55472.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49229.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55472.log.gz 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49229.log.gzgzip 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38727.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42925.log 2024-09-14T07:14:37.659 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50055.log: /var/log/ceph/ceph-client.admin.38727.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38727.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57152.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42925.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57152.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40997.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53794.log: /var/log/ceph/ceph-client.admin.44529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45621.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57110.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40997.log.gz 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45621.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2024-09-14T07:14:37.660 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45621.log.gz 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57110.log: /var/log/ceph/ceph-client.admin.49448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57110.log.gz 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56900.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gzgzip 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53217.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53927.log: /var/log/ceph/ceph-client.admin.56900.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56900.log.gz 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54568.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42136.log 2024-09-14T07:14:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53217.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54568.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42136.log: /var/log/ceph/ceph-client.admin.40147.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42136.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56063.log 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38929.log 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56063.log.gzgzip 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50600.log 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50493.log: /var/log/ceph/ceph-client.admin.38929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38929.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-09-14T07:14:37.662 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39663.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39466.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50600.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39663.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39663.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39782.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39466.log: /var/log/ceph/ceph-osd.3.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39466.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56072.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39782.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52002.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56072.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52002.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54111.log 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2024-09-14T07:14:37.663 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56408.log 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54111.log.gz 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53259.log 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56408.log.gz 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53259.log.gz 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39643.log 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53723.log 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39643.log.gz 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40940.log 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53723.log.gz 2024-09-14T07:14:37.664 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40940.log.gz 2024-09-14T07:14:37.665 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T07:14:37.667 INFO:teuthology.orchestra.run.smithi071.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T07:14:37.704 INFO:teuthology.orchestra.run.smithi086.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T07:14:37.851 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T07:14:37.873 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T07:14:38.276 INFO:teuthology.orchestra.run.smithi086.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T07:14:38.522 INFO:teuthology.orchestra.run.smithi086.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T07:14:39.193 INFO:teuthology.orchestra.run.smithi071.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T07:14:39.217 INFO:teuthology.orchestra.run.smithi086.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T07:14:40.108 INFO:teuthology.orchestra.run.smithi071.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T07:14:40.820 INFO:teuthology.orchestra.run.smithi086.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T07:14:40.822 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-14T07:14:40.822 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m3.278s 2024-09-14T07:14:40.822 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m6.515s 2024-09-14T07:14:40.822 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m0.279s 2024-09-14T07:14:40.935 INFO:teuthology.orchestra.run.smithi071.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T07:14:40.937 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T07:14:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m3.430s 2024-09-14T07:14:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m8.125s 2024-09-14T07:14:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.428s 2024-09-14T07:14:40.938 INFO:tasks.ceph:Archiving logs... 2024-09-14T07:14:40.938 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/remote/smithi071/log 2024-09-14T07:14:40.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T07:14:42.200 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/remote/smithi086/log 2024-09-14T07:14:42.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T07:14:43.084 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T07:14:43.094 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T07:14:43.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T07:14:43.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T07:14:43.183 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T07:14:43.193 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T07:14:43.193 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T07:14:43.196 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T07:14:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-14T07:14:43.213 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-14T07:14:43.215 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T07:14:43.215 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-14T07:14:43.215 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 -631us[ -629us] +/- 41ms 2024-09-14T07:14:43.215 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +820us[ +820us] +/- 55ms 2024-09-14T07:14:43.215 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +90us[ +90us] +/- 89ms 2024-09-14T07:14:43.215 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:14:43.217 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T07:14:43.217 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-14T07:14:43.217 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 -638us[ -640us] +/- 41ms 2024-09-14T07:14:43.217 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +824us[ +826us] +/- 55ms 2024-09-14T07:14:43.218 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +86us[ +84us] +/- 89ms 2024-09-14T07:14:43.218 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T07:14:43.218 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T07:14:43.229 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T07:14:43.230 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T07:14:43.293 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T07:14:43.375 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T07:14:43.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T07:14:43.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:14:43.483 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T07:14:43.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:14:43.514 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T07:14:43.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T07:14:43.538 INFO:teuthology.task.internal:Duration was 614.652693 seconds 2024-09-14T07:14:43.538 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T07:14:43.549 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T07:14:43.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T07:14:43.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T07:14:43.590 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T07:14:43.594 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T07:14:43.948 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T07:14:43.948 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T07:14:43.948 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T07:14:44.009 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T07:14:44.010 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T07:14:44.050 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T07:14:44.051 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T07:14:44.054 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T07:14:44.118 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T07:14:44.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T07:14:44.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T07:14:44.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T07:14:44.283 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T07:14:44.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T07:14:44.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T07:14:44.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T07:14:44.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T07:14:44.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T07:14:44.372 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-14T07:14:44.397 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-14T07:14:44.425 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T07:14:44.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:14:44.445 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T07:14:44.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T07:14:44.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T07:14:44.489 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T07:14:44.490 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/remote/smithi071 2024-09-14T07:14:44.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T07:14:44.532 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900423/remote/smithi086 2024-09-14T07:14:44.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T07:14:44.565 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T07:14:44.566 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T07:14:44.568 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T07:14:44.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T07:14:44.627 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T07:14:44.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T07:14:44.702 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T07:14:44.703 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T07:14:44.705 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T07:14:44.718 INFO:teuthology.orchestra.run.smithi071.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 07:14 /home/ubuntu/cephtest 2024-09-14T07:14:44.720 INFO:teuthology.orchestra.run.smithi086.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 07:14 /home/ubuntu/cephtest 2024-09-14T07:14:44.721 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T07:14:44.732 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T07:14:44.759 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} duration: 614.6526930332184 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T07:14:44.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T07:14:44.837 INFO:teuthology.run:pass